Name |
Dagster |
Apache Airflow |
Description |
A data orchestrator for machine learning, analytics, and ETL. |
Apache Airflow is a platform to programmatically author, schedule, and monitor workflows. |
Source code |
https://github.com/dagster-io/dagster |
https://github.com/apache/airflow |
Website |
https://dagster.io/ |
https://airflow.apache.org/ |
License |
Apache license 2.0 |
Apache license 2.0 |
Year created |
2019 |
2014 |
Company |
Dagster |
Airbnb, Apache |
Use cases |
Data Orchestration, Machine Learning Pipelines |
Workflow scheduling |
Language support |
python |
python |
Has cron schedule support |
yes
|
yes
|
Has event based trigger support |
yes
|
yes
|
Has api support |
yes
|
yes
|
Has access controls |
yes
|
yes
|
Has workflow versioning |
yes
|
no
|
Has workflow configuration support |
yes
|
yes
|
Has audit logs |
yes
|
yes
|
Has cost tracking |
no
|
no
|
Has data source connection support |
no
|
yes
|