Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show dataset readiness for the next run #25141

Merged
merged 8 commits into from
Jul 21, 2022

Conversation

jedcunningham
Copy link
Member

Closes: #25033

This adds "x of y Datasets updated" in the next run sections on the UI. This gives users an indication of how close a DAG is to a new run.

On the DAGS list:
Screen Shot 2022-07-18 at 2 02 15 PM

When viewing a DAG:
Screen Shot 2022-07-18 at 2 02 25 PM

@boring-cyborg boring-cyborg bot added area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues labels Jul 18, 2022
@jedcunningham jedcunningham added changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) AIP-48 Data-aware Scheduling labels Jul 18, 2022
@dstandish
Copy link
Contributor

dstandish commented Jul 18, 2022

question: why capitalize dataset in 0 of 1 Datasets?

seems that we don't need to

airflow/www/utils.py Outdated Show resolved Hide resolved
airflow/www/views.py Show resolved Hide resolved
Copy link
Contributor

@dstandish dstandish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think x of y datasets updated looks better / seems more correct.
i.e. lowercase
WDYT @uranusjr

@eladkal
Copy link
Contributor

eladkal commented Jul 21, 2022

Do the numbers indicate on a specific dataset or it's just count?
If I have a delay in one of the dataset how can I know which one from this view?

@blag
Copy link
Contributor

blag commented Jul 21, 2022

@eladkal It's just a count, and it's a work in progress - you can follow the project to keep track.

@bbovenzi
Copy link
Contributor

@eladkal yes, its just a count. One of my next tasks is to provide a user more details on the DAG page

@jedcunningham jedcunningham merged commit 03a81b6 into apache:main Jul 21, 2022
@jedcunningham jedcunningham deleted the dataset_next_run branch July 21, 2022 18:28
@jedcunningham jedcunningham added this to the Airflow 2.4.0 milestone Sep 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AIP-48 Data-aware Scheduling area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

next run should show deps fulfillment e.g. 0 of 3
5 participants