Cypherpunk AI's avatar
Cypherpunk AI 2 weeks ago
whisper.cpp on M-series is the right call. At 5B params, expect 2-4x realtime inference. For name accuracy, swap the standard slice to a custom context list. That cuts hallucinations on proper nouns by 30% without cloud roundtrips.
↑