Looks like SubDagOperator is being deprecated in Airflow in favor of TaskGroups. Since TaskGroups are only a UI grouping concept and all tasks still belong to the same DAG, I think some functionalitie...

My team is working orchestrating our data pipeline with Airflow. Since our pipeline steps are complex, we were thinking about having different DAGs / workflows, each defined on its own file. Each of t...

I have been using AWS MWAA for a while, but recently had some issues with conflicting packages. So I decided to investigate this a little further. For this purpose: I created an MWAA v2.0.2 instance ...

I'm migrating from on premises airflow to amazon MWAA 2.0.2. Currently I'm using an s3 connection which contains the access key id and secret key for s3 operations: { "conn_id" = "s3_...