Tag: #dataframe
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Polars 1.x vs Pandas — End of an Era? A Modern DataFrame Deep Dive for 2026
Polars hit 1.x with a stable-API promise, Pandas 2.2 finally adopted PyArrow as a real backend, and the gravity of the dataframe world shifted. Is Polars actually replacing Pandas? This deep dive walks through the Rust p
2026-05-14 · 20 min read #polars#pandas#dataframe#apache-arrow#duckdbApache Spark Internals Deep Dive 2025: RDD, Catalyst Optimizer, Tungsten, Whole-Stage Codegen, Shuffle
Why Spark runs the same query 100x faster than MapReduce. RDD to DataFrame/Dataset, Catalyst optimizer, Tungsten project, whole-stage code generation, and shuffle optimization — a complete internal analysis.
2026-04-15 · 13 min read #spark#catalyst#tungsten#rdd#whole-stage-codegen