Fine-Tuning Parakeet for Um-Free, Hebrish Speech
Daniel wants to bend Parakeet to his will: strip the ums, catch niche words, and handle the Hebrew he sprinkles into his English. He's done this before with Whisper, so he knows the shape of the job — but Parakeet is a different animal. This episode walks through what Parakeet TDT 0.6B v3 actually is, why a small model is a better inference candidate but not an easier fine-tune, and the real workflow: NVIDIA NeMo on a rented GPU, a JSON manifest, two learning-rate knobs, then a GGUF conversion and a sideload back to the phone. We dig into the disfluency problem (there's no published Parakeet…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.