Xet, Buckets, and Auto-Pulling Model Weights

My Weird Prompts · Sep 21, 2026 · 21m

Hugging Face quietly migrated 500,000 repositories and 20 petabytes to Xet, a chunk-level dedup engine that replaced file-level Git LFS. This episode unpacks how that migration stayed invisible, why content-defined chunking matters for quantization-heavy model repos, and what Storage Buckets actually are versus repositories. Then it tackles the real question: can a bucket be configured to automatically pull new upstream variants? The answer is no, and the reason is structural, not a missing feature. Episode 5416 — myweirdprompts.com/n/5416 (permanent short link: myweirdprompts.com/260264)