Difference between revisions of "Apache Airflow"
Jump to navigation
Jump to search
| Line 6: | Line 6: | ||
** PIP: <code>[[pip3 install apache-airflow]]</code> | ** PIP: <code>[[pip3 install apache-airflow]]</code> | ||
** Homebrew: not available | ** Homebrew: not available | ||
| + | ** [[Airflow configuration|Configuration]] | ||
** Kubernetes: | ** Kubernetes: | ||
:::<code>[[helm repo add apache-airflow]] https://airflow.apache.org</code> | :::<code>[[helm repo add apache-airflow]] https://airflow.apache.org</code> | ||
Revision as of 10:01, 28 October 2022
wikipedia:Apache Airflow Workflow management system is a platform to programmatically author, schedule, and monitor workflows.
- Cloud Composer
- Installation:
- PIP:
pip3 install apache-airflow - Homebrew: not available
- Configuration
- Kubernetes:
- PIP:
helm repo add apache-airflow https://airflow.apache.orghelm upgrade --install airflow apache-airflow/airflow --namespace airflow --create-namespace
Contents
Commands
Logs
Related
- Directed acyclic graph (DAG)
- Airflow Scheduler
- Amazon Managed Workflows for Apache Airflow (MWAA)
- Apache Airflow providers: https://airflow.apache.org/docs/apache-airflow-providers/
/etc/metricbeat/metricbeat.reference.yml - module: airflow host: "localhost" port: "8126" metricsets: [ 'statsd' ]
See also
- Astronomer and Astronomer Cloud
- Cloud composer service on Google Cloud Platform
- Apache Airflow, Installation, configuration
airflow.cfg, monitoring, Amazon Managed Workflows for Apache Airflow (MWAA),airflow, Airflow Scheduler, providers, Workflows, Airflow executors, Airflow versions, Datadog integration - DAG, Airflow
Advertising:
