Latest / Logosofia no Dia a Dia
Beyond the Blank Slate: The Evolution of AI Training
Think AI labs start from scratch for every new model? Think again. This episode dives into the high-stakes world of continual pre-training and "weight surgery," where trillion-parameter models are expanded and refined rather than rebuilt at a cost of hundreds of millions. We explore how techniques like Sparse Mixture of Experts and elastic weight consolidation allow models to gain new abilities—like multimodal reasoning—without suffering from catastrophic forgetting. Join us as we pull back the curtain on the biological-style evolution of modern AI and why the "clean slate" is now a relic of…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.