Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(flakiness): update flakiness format #4808

Merged
merged 2 commits into from
Aug 6, 2019

Conversation

aslushnikov
Copy link
Contributor

This patch:

  • updates Flakiness Dashboard format to define version per-build
    and to pass COMMIT information
  • drops the README.md generation - we'll move on to a designated flakiness
    dashboard viewer

This patch:
- updates Flakiness Dashboard format to define version per-build
  and to pass COMMIT information
- drops the README.md generation - we'll move on to a designated flakiness
  dashboard viewer
@aslushnikov
Copy link
Contributor Author

aslushnikov commented Aug 6, 2019

NOTE: Prior to landing this commit, I'll migrate all the current flakiness data to the format.

Edit: data updated in flakiness repo.

aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
aslushnikov added a commit to aslushnikov/puppeteer-flakiness-dashboard that referenced this pull request Aug 6, 2019
@@ -111,6 +111,8 @@ new Reporter(testRunner, {
showSlowTests: process.env.CI ? 5 : 0,
});

utils.initializeFlakinessDashboardIfNeeded(testRunner);
testRunner.run();
(async() => {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: can you move this to the top of this file, like line 20. Its easier to reason about this file if the whole thing is async, rather than just one step at the end.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried that initially, but didn't like extra indentation. Does this bother you strongly?

commit: {
sha,
timestamp,
url: `https://github.com/GoogleChrome/puppeteer/commit/${sha}`,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is baking in the repo URL necessary here? The commit hash should be enough.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't want to rely on Github URL schemes too much in flakiness viewer. This comes for free since this is per-build only (and there are not many builds)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What happens if we ever move the repo?

@JoelEinbinder
Copy link
Contributor

JoelEinbinder commented Aug 6, 2019 via email

@aslushnikov
Copy link
Contributor Author

I'll land this now and will discuss the reason for your disturbance offline

@aslushnikov aslushnikov merged commit dcff850 into puppeteer:master Aug 6, 2019
@aslushnikov aslushnikov deleted the flakiness-format branch August 6, 2019 22:32
aslushnikov added a commit that referenced this pull request Aug 8, 2019
rfojtik pushed a commit to rfojtik/puppeteer that referenced this pull request Dec 21, 2019
This patch:
- updates Flakiness Dashboard format to define version per-build
  and to pass COMMIT information
- drops the README.md generation - we'll move on to a designated flakiness
  dashboard viewer
rfojtik pushed a commit to rfojtik/puppeteer that referenced this pull request Dec 21, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants