High Performance DE Substack

High Performance DE Substack

Converting CSV's to Parquet

High Performance DE Newsletter's avatar
High Performance DE Newsletter
Oct 22, 2024
∙ Paid
7
2
Share

CSV files are a vastly common way to exchange and share data; they have their pluses and minuses, but from a cloud strategy perspective, parquet files have become the gold standard. They compress better than CSV, they carry a more formalized schema with them, whereas engines reading CSV’s have to sample several hundred or thousand rows and guess the dat…

Keep reading with a 7-day free trial

Subscribe to High Performance DE Substack to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Matt Martin
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture