Difference between revisions of "Apache Airflow"

Latest revision as of 17:07, 18 January 2023

wikipedia:Apache Airflow Workflow management system is a platform to programmatically author, schedule, and monitor workflows.

/etc/metricbeat/metricbeat.reference.yml
- module: airflow
  host: "localhost"
  port: "8126"
  metricsets: [ 'statsd' ]

@@ Line 1: / Line 1: @@
-[[wikipedia:Apache Airflow]]
+[[wikipedia:Apache Airflow]] [[Workflow management system]] is a platform to programmatically author, schedule, and monitor workflows.
+* https://airflow.apache.org/
+* [[Cloud Composer]]
+* [[Apache Airflow installation|Installation]]
+== Commands ==
+* <code>[[airflow --help]]</code>
+* <code>[[airflow db]]</code>
+* <code>[[airflow webserver]]</code>
+* <code>[[airflow standalone]]</code>
+* <code>[[airflow version]]</code>
+== Logs ==
+* [[Started process]]
+* [[Fluentd]] recommended for logs
+* [[StatsD]] recommended for metrics to [[Prometheus]]
+== Related ==
+* [[Directed acyclic graph (DAG)]]
+* [[Drawing DAGs]]
+* [[Airflow Scheduler]]
+* [[Airflow Operators]]
+* [[Job scheduler]]
+* [[Apache NiFi]]
+* [[Amazon Managed Workflows for Apache Airflow (MWAA)]] (May 2021))
+* [[Apache Airflow providers]]: https://airflow.apache.org/docs/apache-airflow-providers/
+ [[/etc/metricbeat/metricbeat.reference.yml]]
+ - module: airflow
+   host: "localhost"
+   port: "8126"
+   metricsets: [ '[[statsd]]' ]
+* [[Apache airflow metrics]]
+* [[Running Airflow in Docker]]
+== Activities ==
+* Read https://www.astronomer.io/blog/7-common-errors-to-check-when-debugging-airflow-dag/
+* [[Datadog Airflow integration]]
+== See also ==
+* [[Astronomer]] and [[Astronomer Cloud]]
+* [[Cloud composer]] service on [[Google Cloud Platform]]
+* {{airflow cmd}}
+* {{Airflow}}
+[[Category:Apache]]
+[[Category:Airflow]]