Apache Airflow 3.0 Release
a year ago
- #Apache Airflow
- #Open Source
- #Data Orchestration
- Apache Airflow 3.0 has been released, marking the biggest release in Airflow's history.
- Airflow 3.0 includes major UX improvements like a new React-based UI, DAG Versioning, and better Backfill support.
- The release introduces Event-Driven Scheduling, enabling integration with external messaging providers.
- Task Execution Interface and Task SDKs enhance security and scalability across multi-cloud and hybrid environments.
- Airflow 3.0 supports execution in any environment and language, with initial TaskSDKs for Python and upcoming support for Golang.
- Data Assets replace Datasets, with new syntax and capabilities for defining and reacting to external data changes.
- The UI has been completely modernized with FastAPI and React, improving both asset and task-oriented workflows.
- Security improvements include task isolation and a split CLI for better maintenance and remote access.
- Over 300 developers contributed to this release, highlighting the strong community support.
- Future plans include gathering feedback and continuing to evolve Airflow's capabilities.