Difference between revisions of "Airflow executors"
Jump to navigation
Jump to search
| (8 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| − | + | * https://airflow.apache.org/docs/apache-airflow/stable/executor/index.html | |
[[airflow info]] | grep executor | [[airflow info]] | grep executor | ||
| Line 6: | Line 6: | ||
[[airflow.cfg]] | [[airflow.cfg]] | ||
| − | . | + | # The executor class that airflow should use. Choices include |
| + | # ``[[SequentialExecutor]]``, ``[[LocalExecutor]]``, ``[[CeleryExecutor]]``, ``[[DaskExecutor]]``, | ||
| + | # ``[[KubernetesExecutor]]``, ``[[CeleryKubernetesExecutor]]`` or the | ||
| + | # full import path to the class when using a custom executor. | ||
executor = SequentialExecutor | executor = SequentialExecutor | ||
| + | |||
| + | |||
| + | |||
| + | [[airflow celery worker]] | ||
.../... | .../... | ||
| + | airflow command error: argument GROUP_OR_COMMAND: celery subcommand works only with [[CeleryExecutor]], [[CeleryKubernetesExecutor]] and executors derived from them, your current executor: | ||
| + | SequentialExecutor, subclassed from: BaseExecutor, see help above. | ||
| + | |||
| + | == Related == | ||
| + | * <code>[[airflow standalone]]</code> | ||
| + | * [[Airflow providers]] | ||
| + | * [[Airflow Operators]] | ||
== See also == | == See also == | ||
| − | |||
* {{Airflow executors}} | * {{Airflow executors}} | ||
* {{Airflow}} | * {{Airflow}} | ||
[[Category:Airflow]] | [[Category:Airflow]] | ||
Latest revision as of 11:01, 20 December 2022
airflow info | grep executor executor | SequentialExecutor
airflow.cfg # The executor class that airflow should use. Choices include # ``SequentialExecutor``, ``LocalExecutor``, ``CeleryExecutor``, ``DaskExecutor``, # ``KubernetesExecutor``, ``CeleryKubernetesExecutor`` or the # full import path to the class when using a custom executor. executor = SequentialExecutor
airflow celery worker .../... airflow command error: argument GROUP_OR_COMMAND: celery subcommand works only with CeleryExecutor, CeleryKubernetesExecutor and executors derived from them, your current executor: SequentialExecutor, subclassed from: BaseExecutor, see help above.
Related[edit]
See also[edit]
- Airflow executors:
LocalExecutor, CeleryExecutor, CeleryKubernetesExecutor, KubernetesExecutor - Apache Airflow, Installation, configuration
airflow.cfg, monitoring, Amazon Managed Workflows for Apache Airflow (MWAA),airflow, Airflow Scheduler, providers, Workflows, Airflow executors, Airflow versions, Datadog integration
Advertising:
