Apache Airflow
The industry-standard platform for programmatically authoring, scheduling, and monitoring workflows.
- MCP
- CLI
- 10
- Skills
About Apache Airflow
The industry-standard platform for programmatically authoring, scheduling, and monitoring workflows. Explore how Apache Airflow integrates with the agentic data stack ecosystem and supports autonomous data operations.
Key Features
- Python-native DAG authoring with dynamic pipeline generation and Jinja templating
- Extensive operator library: BashOperator, PythonOperator, KubernetesPodOperator, and 1000+ providers
- Rich web UI for monitoring DAG runs, task logs, Gantt charts, and dependency graphs
- Flexible scheduling with cron expressions, timetables, data-aware scheduling, and event triggers
- Built-in retry logic, SLA monitoring, alerting, and failure callbacks
- Provider ecosystem with 80+ packages for AWS, GCP, Azure, Databricks, Snowflake, dbt, and more
- TaskFlow API for writing DAGs as decorated Python functions with automatic XCom passing
- Horizontal scalability with Celery, Kubernetes, or local executors
External Links
Astronomer Airflow MCP ServerOfficial MCP server for Airflow — DAG management, task monitoring, log access via AI assistantsAstronomer Agent Skills22 agentskills.io-spec skills for Airflow workflows: DAG authoring, debugging, testing, deployment, and moreAirflow Provider Packages80+ official provider packages for cloud services, databases, and data toolsAstro CLIAstronomer CLI for local Airflow development, testing, and deployment to Astro CloudAirflow REST APIStable REST API for programmatic DAG triggering, monitoring, and management
← Back to Scheduler