Latest / Logosofia no Dia a Dia
Fine-Tuning DeepSeek for One Podcast
After thousands of episodes, we've noticed DeepSeek has some persistent quirks — overused words, recycled analogy templates, and habits no system prompt seems to cure. What if we took a hundred scripts, wrote human feedback on each, and fine-tuned a version of DeepSeek optimized solely for producing this podcast? This episode breaks down the practical steps: collecting feedback data, choosing between supervised fine-tuning and DPO, structuring training examples within DeepSeek's 128K context window, and using LoRA to avoid catastrophic forgetting. We also tackle the question of where…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.