Difference between revisions of "Airflow executors"

From wikieduonline
Jump to navigation Jump to search
 
(7 intermediate revisions by the same user not shown)
Line 6: Line 6:
  
 
  [[airflow.cfg]]
 
  [[airflow.cfg]]
  .../...
+
  # The executor class that airflow should use. Choices include
 +
# ``[[SequentialExecutor]]``, ``[[LocalExecutor]]``, ``[[CeleryExecutor]]``, ``[[DaskExecutor]]``,
 +
# ``[[KubernetesExecutor]]``, ``[[CeleryKubernetesExecutor]]`` or the
 +
# full import path to the class when using a custom executor.
 
  executor = SequentialExecutor
 
  executor = SequentialExecutor
 +
 +
 +
 +
[[airflow celery worker]]
 
  .../...
 
  .../...
 +
airflow command error: argument GROUP_OR_COMMAND: celery subcommand works only with [[CeleryExecutor]], [[CeleryKubernetesExecutor]] and executors derived from them, your current executor:
 +
SequentialExecutor, subclassed from: BaseExecutor, see help above.
 +
 +
== Related ==
 +
* <code>[[airflow standalone]]</code>
 +
* [[Airflow providers]]
 +
* [[Airflow Operators]]
  
 
== See also ==
 
== See also ==

Latest revision as of 11:01, 20 December 2022

airflow info | grep executor
executor               | SequentialExecutor


airflow.cfg
# The executor class that airflow should use. Choices include
# ``SequentialExecutor``, ``LocalExecutor``, ``CeleryExecutor``, ``DaskExecutor``,
# ``KubernetesExecutor``, ``CeleryKubernetesExecutor`` or the
# full import path to the class when using a custom executor.
executor = SequentialExecutor


airflow celery worker
.../...
airflow command error: argument GROUP_OR_COMMAND: celery subcommand works only with CeleryExecutor, CeleryKubernetesExecutor and executors derived from them, your current executor: 
SequentialExecutor, subclassed from: BaseExecutor, see help above.

Related[edit]

See also[edit]

Advertising: