Questions about airflow-2.x
Read more about airflow-2.x
python (12.9k questions)
javascript (9.2k questions)
reactjs (4.7k questions)
java (4.2k questions)
java (4.2k questions)
c# (3.5k questions)
c# (3.5k questions)
html (3.3k questions)
Dynamic task creation using decorators in Airflow 2
I would like to create tasks dynamically in a flow based on the result from another task. Is it somehow possible to do it in the following way ?
I am able to do that by storing data from task in a tem...
Ania
Votes: 0
Answers: 1
BackFill individual Airflow TaskGroups
Looks like SubDagOperator is being deprecated in Airflow in favor of TaskGroups. Since TaskGroups are only a UI grouping concept and all tasks still belong to the same DAG, I think some functionalitie...
Raquel
Votes: 0
Answers: 0
Airflow DAG Dependencies / Orchestration between different workflows
My team is working orchestrating our data pipeline with Airflow. Since our pipeline steps are complex, we were thinking about having different DAGs / workflows, each defined on its own file. Each of t...
Raquel
Votes: 0
Answers: 0
Airflow - TaskGroup - looping through list of dictionaries to get multiple values - unhashable type: 'dict'
I'm trying to get the appropriate values in this list of dictionaries, which includes calling classes from 'table_name'. But I keep getting multiple errors, currently I'm seeing:
copy_VE_to_s3 = {gro...
KristiLuna
Votes: 0
Answers: 1