LabHub

Blog

Airflow Basics

한국어English日本語

The Core Components

Airflow's Core Components consist of a Web Server, a Database, and a Scheduler.

Web Server

Users can manage DAGs and check the status of Tasks through the Web Server's UI. Serves the User Interface.

Meta Database

The Meta Database can use PostgreSQL, MySQL, or SQL Lite. Contains Airflow metadata (Task instances, workflows, etc.).

Scheduler

The Scheduler uses an executor to perform actual operations. You can choose and run the desired Executor from Celery, Kubernetes, or Local Executor.

A Worker can be a Subprocess or a Dedicated machine. Schedules tasks while checking dependencies are met.

Quiz

Q1: What is the main topic covered in "Airflow Basics"? The Basics of Apache Airflow

Q2: What is Web Server? Users can manage DAGs and check the status of Tasks through the Web Server's UI. Serves the User Interface.

Q3: Explain the core concept of Meta Database. The Meta Database can use PostgreSQL, MySQL, or SQL Lite. Contains Airflow metadata (Task instances, workflows, etc.).

Q4: What are the key aspects of Scheduler? The Scheduler uses an executor to perform actual operations. You can choose and run the desired Executor from Celery, Kubernetes, or Local Executor. A Worker can be a Subprocess or a Dedicated machine. Schedules tasks while checking dependencies are met.

Comments

No comments yet.

Sign in to leave a comment