Tag: #apache-spark
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Data Engineering Complete Guide 2025: Flink vs Spark, dbt, Iceberg, Airflow — Modern Data Stack Deep Dive
Flink vs Spark stream processing comparison, dbt crossing $100M ARR, Iceberg vs Delta Lake vs Hudi lakehouse showdown, ClickHouse vs StarRocks real-time analytics, Airflow 3.0 vs Dagster vs Prefect orchestration — the co
2026-03-22 · 30 min read #data-engineering#apache-flink#apache-spark#dbt#apache-icebergData Engineering & AI Pipeline Guide: From Apache Spark to Kafka
A comprehensive guide to data engineering for AI. Covers Apache Spark, Kafka, Airflow, dbt, Delta Lake, and Feature Stores for designing and implementing large-scale data pipelines.
2026-03-17 · 12 min read #data-engineering#apache-spark#kafka#airflow#dbt