Tag: #etl
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 4 posts
Automating Data Cleaning with Power Query — Reports That Refresh in One Click
A step-by-step guide to automating data import and transformation with Power Query. Covers combining folders, merging and appending queries, parameters, a taste of the M language, refresh automation and its limits, plus
2026-06-15 · 9 min read #excel#productivity#power-query#etl#data-cleaningCDC (Change Data Capture) Complete Guide 2025: Debezium, Kafka, Data Sync, Outbox Pattern
Everything about CDC — how it works (WAL/binlog based), Debezium architecture, PostgreSQL Logical Replication, MySQL binlog, Outbox Pattern, data warehouse sync, Kafka integration, migration, common pitfalls.
2026-04-15 · 11 min read #cdc#debezium#kafka#postgresql#mysqlData Engineering Fundamentals — ETL, Data Warehouses, Streaming, and Data Lakes
How do you build data pipelines? From ETL/ELT and data warehouses to streaming, batch processing, Spark, Kafka, and Airflow.
2026-04-13 · 17 min read #data-engineering-aws#data-engineering#etl#data-warehouse#sparkData Engineering Pipeline Complete Guide 2025: ETL/ELT, Spark, Airflow, Real-Time Streaming
Everything about data engineering! ETL vs ELT, Apache Spark (PySpark), Apache Airflow (DAG/Operator/Sensor), real-time streaming (Kafka+Flink), dbt (data transformation), data warehouses (BigQuery/Snowflake/Redshift), da
2026-03-25 · 18 min read #data-engineering#etl#elt#spark#airflow