JSON-L vs Parquet: When Each Format Wins

Logosofia no Dia a Dia · Apr 26, 2026 · 28m

JSON-L and Parquet are the workhorses of modern data pipelines, but they solve fundamentally different problems. This episode explores exactly how far JSON-L can scale before memory becomes an issue, why Parquet achieves 5x compression over CSV, and the surprising trade-offs between streaming simplicity and columnar performance. We dig into Hugging Face's automatic Parquet conversion, the small-files problem nobody talks about, and when the file-as-database pattern actually beats MongoDB and SQLite. If you've ever wondered whether to reach for JSON-L or Parquet, this episode gives you the…