So I have an Apache airflow DAG that gets called with a text parameter, let's name it param, and also has a subparam that's a list of characteristics of the param. For each pair of (param,subparam) the DAG is able to run a certain process, that for safety need to be blocked if another execution already has a subparam in common. Said process consists of 3 tasks that take these variables into account for their execution.
I tried using pools, but cannot seem to get it working properly. I even tried to only allow parallel runs of different param, so to avoid having to check if any of their subparams coincide, but still had no luck.
Any ideas if this is possible, or maybe I need to define a separate set of tasks for each param?