Race condition in multiple triggerer process can lead to both picking up same trigger.

[iw-pavan]

Apache Airflow version

main (development)

What happened

Currently airflow triggerer loop picks triggers to process by below steps

query_unassinged_Triggers
update_triggers from above id
query which triggers are assigned to current process

If two triggerer process executes above queries in below order

query unassigned trigger both will get all triggers then if one triggerer completes 2nd and 3rd operation before 2nd triggerer does 2nd operation that will lead to both triggerer running same triggers
there is sync happening after that but unnecessary cleanup operations are done in that case.

What you think should happen instead

There should be locking on rows which are updated.

How to reproduce

No response

Operating System

All

Versions of Apache Airflow Providers

No response

Deployment

Virtualenv installation

Deployment details

HA setup with multiple triggerers can have this issue

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[o-nikolas]

Hey @iw-pavan! Thanks for submitting this issue 😄 I see that you've checked that you're willing to submit a PR, would you like me to assign this issue to you?

[pavansharma36]

@o-nikolas I've raised PR with fix, you can assign this to me