Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed Index is now expressed in seconds? #6130

Closed
darylljann opened this issue Sep 28, 2018 · 6 comments
Closed

Speed Index is now expressed in seconds? #6130

darylljann opened this issue Sep 28, 2018 · 6 comments

Comments

@darylljann
Copy link

Summary

Is there any supporting documentation regarding this change?

Can't find any info in
https://sites.google.com/a/webpagetest.org/docs/using-webpagetest/metrics/speed-index
https://github.com/paulirish/speedline

Lighthouse v2

image

Lighthouse v3

image

@paulirish
Copy link
Member

paulirish commented Sep 28, 2018

hi @darylljann.

We think that the milliseconds unit communicates too much resolution for these values. On repeated runs all these numbers can move around a bit, so presenting them with the seconds unit hopefully clarifies their precision.

Also we noticed that typically when people were talking about their lighthouse report, they were mentally converting to seconds before sharing the metric results.

That's about the best documentation we have on the topic. :)

Does that make sense?

cc original PR #5914

@darylljann
Copy link
Author

darylljann commented Sep 28, 2018

Fair enough. Is Lighthouse now using Speed Index vs Perceptual Speed Index? The score used to be unitless as well.

@paulirish
Copy link
Member

ah. just clicked through on WPT's docs page and I better understand why you brought this up.
image

And I recalled that historically Speed Index is shown unitless. (Mostly because nothing significant happened at that particular timestamp.)


So here's the backstory:

  • When Lighthouse first added Speed Index, we showed it as unitless, keeping consistency with how it's historically been shown.
  • At some point (LH v3.0 I think), we decided to show it with the ms unit. Because, really, it is. And it clarifies that these metrics are on the same timescale. (@benschwarz actually helped convince me that adding a unit was valuable. He was telling me one of his customers had couldn't effectively explain it to people outside of the dev team without the unit)
  • Now in LH v3.1.0 we changed our load metrics from milliseconds to seconds for the reasons i listed above. :)

+@pmeenan: I figure I should ask the owner.. :) Does this work for you? A speed index of "4570" being displayed as "4.5s"?


Is Lighthouse using Speed Index now vs Perceptual Speed Index?

Yeah while we like some of the ideas in Perceptual Speed Index, it has some flaws too. And it since it's so similar to Speed Index, it wasn't worth it any longer to present a different metric than you see other performance tools. :)

@pmeenan
Copy link

pmeenan commented Sep 28, 2018

sgtm. I just updated WebPageTest to display it in seconds as well since that's generally how we think about it anyway.

@paulirish
Copy link
Member

Hah. Works for me! 👍

@darylljann
Copy link
Author

Cheers folks 🙌🏼

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants