I'm using Airflow v2.2.3 and apache-airflow-providers-elasticsearch==2.1.0, running in Kubernetes. Our logs are automatically shipped to Elasticsearch v7.6.2. I set the following configurations in Air...

Looks like SubDagOperator is being deprecated in Airflow in favor of TaskGroups. Since TaskGroups are only a UI grouping concept and all tasks still belong to the same DAG, I think some functionalitie...

My team is working orchestrating our data pipeline with Airflow. Since our pipeline steps are complex, we were thinking about having different DAGs / workflows, each defined on its own file. Each of t...

I'm trying to automate the creation of batch pipelines from backend mySQLL to BiqQuery and I've ran into issue with my script. It initialises a DAG with it's own class (DagCreator) and then passes it ...