Latest / Logosofia no Dia a Dia
Serving DeepSeek-V4.1-Flash on Your Own GPU
You've got the weights, you've got the rack, you've got a GPU bolted in that you're not replacing. So which engines can actually serve DeepSeek-V4.1-Flash — and how much of your "engine choice" is really a hardware decision wearing a software costume? This episode walks the five-name shortlist (vLLM, SGLang, TensorRT-LLM, llama.cpp, ONNX Runtime) against the model card's supported paths, then runs the two-server thought experiment: one NVIDIA box, one AMD box, same budget line, wildly different menus. Along the way: why the most portable engine is the one that can't load the model, why…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.