Tag: #dbt
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 8 posts
Hadoop Ecosystem & Data Engineering 2026 Deep Dive - Hadoop, Spark, Flink, Trino, Iceberg, Delta Lake, Hudi, Airflow, dbt
A complete look at the data engineering stack in May 2026. The truth behind the "Hadoop is dead" headline (HDFS is shrinking, but YARN and the lakehouse pattern survive), the conclusion of the Iceberg vs Delta Lake vs Hu
2026-05-16 · 25 min read #hadoop#spark#flink#trino#prestoData Lakehouse & Modern Data Engineering 2026 — Iceberg / Delta / Hudi / Paimon / Tabular (Databricks acquisition) / Trino / Spark 4 / Flink 2 / DataFusion Deep Dive
Data engineering in 2026 is no longer the era of "data warehouse vs data lake." Apache Iceberg emerged as the winner of the 2024-25 table format war — Netflix, Apple, LinkedIn, Stripe, Airbnb all converged on it. Databri
2026-05-16 · 30 min read #data-engineering#data-lakehouse#apache-iceberg#delta-lake#apache-hudiData Engineering Complete Guide — Lakehouse, Streaming, dbt, Orchestration, Data Mesh (Season 2 Ep 8, 2025)
Data engineering is no longer "running ETL scripts." In 2025 a data engineer designs Lakehouse architectures (Iceberg, Delta, Hudi), combines Streaming (Flink, Kafka) with Batch (Spark), standardizes modeling with dbt, r
2026-04-15 · 10 min read #data-engineering#lakehouse#iceberg#delta-lake#hudiData Orchestration 2025 Complete Guide: dbt, SQLMesh, Dagster, Airflow, Prefect, Data Contracts, CI/CD (2025)
Season 5 Ep 4. If engines query, orchestrators govern the pipelines. The standardization of dbt and its limits, the revolt of SQLMesh, the asset-centric model of Dagster, the evolution of Airflow 2.x and 3.0, the rebirth
2026-04-15 · 13 min read #data-orchestration#dbt#sqlmesh#dagster#airflowData Engineering Pipeline Complete Guide 2025: ETL/ELT, Spark, Airflow, Real-Time Streaming
Everything about data engineering! ETL vs ELT, Apache Spark (PySpark), Apache Airflow (DAG/Operator/Sensor), real-time streaming (Kafka+Flink), dbt (data transformation), data warehouses (BigQuery/Snowflake/Redshift), da
2026-03-25 · 18 min read #data-engineering#etl#elt#spark#airflowSnowflake Data Engineer Career Guide: Mastering the Cloud Data Warehouse King
A complete analysis of the Snowflake Data Engineer role. Snowflake architecture (compute-storage separation), Snowpark, Cortex AI, Iceberg Tables, dbt integration, streaming (Snowpipe), cost optimization — 20 interview q
2026-03-23 · 24 min read #snowflake#data-engineering#data-warehouse#sql#dbtData Engineering Complete Guide 2025: Flink vs Spark, dbt, Iceberg, Airflow — Modern Data Stack Deep Dive
Flink vs Spark stream processing comparison, dbt crossing $100M ARR, Iceberg vs Delta Lake vs Hudi lakehouse showdown, ClickHouse vs StarRocks real-time analytics, Airflow 3.0 vs Dagster vs Prefect orchestration — the co
2026-03-22 · 30 min read #data-engineering#apache-flink#apache-spark#dbt#apache-icebergData Engineering & AI Pipeline Guide: From Apache Spark to Kafka
A comprehensive guide to data engineering for AI. Covers Apache Spark, Kafka, Airflow, dbt, Delta Lake, and Feature Stores for designing and implementing large-scale data pipelines.
2026-03-17 · 12 min read #data-engineering#apache-spark#kafka#airflow#dbt