Tag: #hadoop
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 28 posts
Revisiting Hadoop Architecture — HDFS, YARN, and Beyond
A diagram-driven walkthrough of Hadoop core internals — HDFS, YARN, and how MapReduce works. We look at how Hadoop role has shifted in the era of object storage, the cloud, and the lakehouse, and how we should understand
2026-06-27 · 30 min read #hadoop#hdfs#yarn#mapreduce#lakehouseModern Hadoop & Big Data Ecosystem 2026 Deep Dive - Hadoop 3.4 · Spark 4 · Hive 4 · Kafka 4 · Flink 2 · Iceberg · Trino
In 2026 Hadoop and the broader big-data ecosystem are not dead — they have been relocated. Hadoop 3.4 Erasure Coding and Ozone, Spark 4 ANSI mode and Spark Connect, Hive 4 Iceberg integration, Kafka 4 with KRaft GA and t
2026-05-16 · 26 min read #english#hadoop#spark#hive#kafkaHadoop Ecosystem & Data Engineering 2026 Deep Dive - Hadoop, Spark, Flink, Trino, Iceberg, Delta Lake, Hudi, Airflow, dbt
A complete look at the data engineering stack in May 2026. The truth behind the "Hadoop is dead" headline (HDFS is shrinking, but YARN and the lakehouse pattern survive), the conclusion of the Iceberg vs Delta Lake vs Hu
2026-05-16 · 25 min read #hadoop#spark#flink#trino#prestoIs Hadoop Dead? — The Evolution of the Big Data Stack, From Hadoop to Lakehouse (Spark, Iceberg, Delta, and Where Things Actually Stand in 2026)
Is Hadoop dead? More precisely — it has been demoted from the default. The HDFS plus YARN plus MapReduce trio is no longer how anyone starts a new analytics platform. Spark replaced MapReduce, object storage replaced HDF
2026-05-14 · 21 min read #hadoop#big-data#spark#iceberg#delta-lakeApache Iceberg Data Lakehouse Table Format Guide
A comprehensive guide to Apache Iceberg table format for data lakehouse architecture, covering schema evolution, partitioning, time travel, and query optimization.
2026-03-14 · 27 min read #apache-iceberg#data-lakehouse#big-data#hadoop#sparkHBase Practical Guide: From Large-Scale NoSQL Data Store Design to Operations
A comprehensive guide covering everything you need for real-world HBase operations, from understanding the data model and architecture to table design, RowKey strategies, read/write performance optimization, Region manag
2026-03-08 · 16 min read #hadoop#hbase#nosql#big-data#databaseHadoop Ecosystem Operations Guide: HDFS, YARN, and MapReduce Operational Standards
Practical operational standards for running Hadoop clusters: HDFS capacity management, YARN queue design, MapReduce job tuning, monitoring, and troubleshooting.
2026-03-08 · 20 min read #hadoop#hdfs#yarn#mapreduce#databaseHadoop Ecosystem Practical Guide: HDFS, MapReduce, and YARN Core Concepts
A comprehensive guide covering the architecture and internals of Hadoop's core components -- HDFS, MapReduce, and YARN -- along with practical operational know-how from cluster setup to performance tuning and monitoring.
2026-03-08 · 14 min read #hadoop#hdfs#mapreduce#yarn#big-datahue 4.10.0 version install on rockyos8
Learn how to install hue 4.10.0 version on Rocky OS 8.
2023-09-06 · 5 min read #hadoop#hueWhat is Hadoop's OS 'YARN'?
Learn about YARN (Yet Another Resource Negotiator), a platform that runs on Hadoop to manage cluster resources and execute distributed processing applications.
2023-09-02 · 4 min read #hadoop#yarnWhat is a Block-Based File System? HDFS Block File System.
Learn about block-based file systems and compare them with HDFS.
2023-09-02 · 19 min read #hadoop#hdfsHDFS NameNode and DataNode
Learn about the architecture, roles, and functions of the NameNode and DataNode, the core components of HDFS.
2023-09-02 · 3 min read #hadoop#hdfsHow to Install HBase Fully Distributed Mode on Ubuntu 22.04
Learn how to install HBase in fully distributed mode on Ubuntu 22.04.
2023-02-18 · 4 min read #hbase#hadoopHow to Presplit HBase Tables
Learn how to presplit tables when creating them in HBase.
2023-01-01 · 2 min read #hbase#hadoopHow to Build Hadoop 3.4 (Ubuntu 22.04)
Learn how to build Hadoop 3.4 on Ubuntu 22.04.
2022-12-25 · 5 min read #linux#hadoop#dockerHow to Build Apache Zookeeper (Ubuntu 22.04)
Learn how to build Apache Zookeeper on Ubuntu 22.04.
2022-12-25 · 1 min read #hadoop#zookeeperHadoop 3.4 Install on Ubuntu(Non Secure)
Learn how to install Hadoop 3.4 (Non Secure) version on Ubuntu.
2022-12-25 · 3 min read #hadoop#javaHow to Integrate HBase with Hive
Learn how to integrate HBase with Hive.
2022-11-27 · 3 min read #hadoop#hbase#hiveHow to Install Spark on YARN
Learn how to install Spark on YARN.
2022-11-26 · 7 min read #hadoop#spark#yarnApache Hive Query Example (MovieLens)
Learn how to use Apache Hive queries with the MovieLens dataset
2022-11-24 · 3 min read #hadoop#hive#sql