Tag: #columnar-storage
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Parquet 2.13.0 Adds nan_count and IEEE 754 Total Order — How Float Statistics Got Fixed After 3 Years and 3 Months
Parquet's min/max statistics are the mechanism that lets query engines skip data. But on floating-point columns, this mechanism has been subtly broken for over 10 years — NaN returns false in every comparison, so it gets
2026-07-16 · 17 min read #data-engineering#parquet#columnar-storage#apache-arrowColumnar Storage Deep Dive 2025: Parquet, ORC, Apache Arrow, Dremel — Why Analytics DBs Are 10,000x Faster
How Snowflake, BigQuery, and Spark query terabytes in seconds. A complete tour of Parquet Dremel structure, ORC, Apache Arrow in-memory format, RLE/Dictionary compression, and vectorized execution.
2026-04-15 · 13 min read #columnar-storage#parquet#orc#apache-arrow#dremel