|
- Apache Airflow
Apache Airflow® provides many plug-and-play operators that are ready to execute your tasks on Google Cloud Platform, Amazon Web Services, Microsoft Azure and many other third-party services
- What is Airflow®? — Airflow 3. 0. 2 Documentation - Apache Airflow
Apache Airflow® is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows Airflow’s extensible Python framework enables you to build workflows connecting with virtually any technology
- Documentation - Apache Airflow
Airflow has an official Helm Chart that will help you set up your own Airflow on a cloud on-prem Kubernetes environment and leverage its scalable nature to support a large group of users
- Tutorials — Airflow 3. 0. 2 Documentation
Tutorials ¶ Once you have Airflow up and running with the Quick Start, these tutorials are a great way to get a sense for how Airflow works
- Installation of Airflow® — Airflow 3. 0. 2 Documentation
You are responsible for setting up the database, creating and managing database schema with airflow db commands, automated startup and recovery, maintenance, cleanup and upgrades of Airflow and the Airflow Providers
- Quick Start — Airflow 3. 0. 2 Documentation
Note Successful installation requires a Python 3 environment Starting with Airflow 2 7 0, Airflow supports Python 3 9, 3 10, 3 11, and 3 12 Officially supported installation methods include pip and uv Both tools provide a streamlined workflow for installing Airflow and managing dependencies
- Core Concepts — Airflow 3. 0. 2 Documentation
Here you can find detailed documentation about each one of the core concepts of Apache Airflow® and how to use them, as well as a high-level architectural overview
- Apache Airflow® 3 is Generally Available! | Apache Airflow
Airflow 3 is significantly easier to use for data practitioners and incorporates their key requests for critical changes to Airflow Early user reactions to features such as the new React based UI, DAG Versioning, and improved Backfill support have been incredibly positive
|
|
|