Latest / Logosofia no Dia a Dia
Teaching a Model Your Voice: SFT vs DPO
You can't reliably prompt a model into your voice — system prompts plateau. So what actually works? This episode works through three data-generation strategies for style fine-tuning: regenerating transcripts with global comments, hand-editing transcripts and training on the diff, and training a purely negative counterweight against overused phrases. A July arXiv paper by Federico Boggia on epanorthosis (the mid-sentence self-correction tic) tested almost exactly this, and one implementation failed in a very instructive way: a small-data DPO adapter learned to rank outputs correctly and then…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.