Small Models, Big Schemas: When JSON Constraints Backfire
Everyone building agents reaches for the biggest model and wraps every endpoint as a tool. But there's a quieter pattern: tiny text-to-text models doing one narrow structured job. Daniel wrote in asking whether small models doing predictable structured output inside MCP pipelines actually ship in production, or whether everyone just lets a general-purpose model emit tool calls. The answer runs through Todoist's MCP servers, a 7B structured-object model from Amazon Science, and a May 2026 study called The Constraint Tax, which found that hard answer-only schemas pushed schema validity to 100%…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.