Tag: #hdfs
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 6 posts
Revisiting Hadoop Architecture — HDFS, YARN, and Beyond
A diagram-driven walkthrough of Hadoop core internals — HDFS, YARN, and how MapReduce works. We look at how Hadoop role has shifted in the era of object storage, the cloud, and the lakehouse, and how we should understand
2026-06-27 · 30 min read #hadoop#hdfs#yarn#mapreduce#lakehouseModern Hadoop & Big Data Ecosystem 2026 Deep Dive - Hadoop 3.4 · Spark 4 · Hive 4 · Kafka 4 · Flink 2 · Iceberg · Trino
In 2026 Hadoop and the broader big-data ecosystem are not dead — they have been relocated. Hadoop 3.4 Erasure Coding and Ozone, Spark 4 ANSI mode and Spark Connect, Hive 4 Iceberg integration, Kafka 4 with KRaft GA and t
2026-05-16 · 26 min read #english#hadoop#spark#hive#kafkaHadoop Ecosystem Operations Guide: HDFS, YARN, and MapReduce Operational Standards
Practical operational standards for running Hadoop clusters: HDFS capacity management, YARN queue design, MapReduce job tuning, monitoring, and troubleshooting.
2026-03-08 · 20 min read #hadoop#hdfs#yarn#mapreduce#databaseHadoop Ecosystem Practical Guide: HDFS, MapReduce, and YARN Core Concepts
A comprehensive guide covering the architecture and internals of Hadoop's core components -- HDFS, MapReduce, and YARN -- along with practical operational know-how from cluster setup to performance tuning and monitoring.
2026-03-08 · 14 min read #hadoop#hdfs#mapreduce#yarn#big-dataWhat is a Block-Based File System? HDFS Block File System.
Learn about block-based file systems and compare them with HDFS.
2023-09-02 · 19 min read #hadoop#hdfsHDFS NameNode and DataNode
Learn about the architecture, roles, and functions of the NameNode and DataNode, the core components of HDFS.
2023-09-02 · 3 min read #hadoop#hdfs