Integration of Kubernetes with Apache Airflow : <p>We are building workflow scheduling application. We found Airflow as a good option for workflow manager and Kubernetes as good option for Cluster manager. Thus, flow would be, </p>

<ol>
<li>We will submit workflow DAG to Airflow.</li>
<li>Airflow should submit the tasks of a given DAG to Kubernetes by specifying docker image.</li>
<li>Kubernetes should execute the task by running docker container on an available EC2 worker node of a cluster. </li>
</ol>

<p>On searching, we found, Airflow has Operators for integrating with ECS, Mesos but not for Kubernetes. However, we found a request for Kubernetes Operator on <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71013666" rel="noreferrer">Airflow wiki</a>, but not any further update on it. </p>

<p>So, the question to be simply put is, how to integrate Airflow with Kubernetes?</p>
