Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tests] - optimize trace testing #1659

Merged
merged 5 commits into from
Jul 8, 2024

Conversation

puckpuck
Copy link
Contributor

@puckpuck puckpuck commented Jul 4, 2024

Changes

Significantly optimizes trace based testing going from 10 minutes to about 1 minute to run all tests. This was done by doing 3 main things:

  1. Run all tests concurrently instead of sequentially. This was the largest contributor to the improvements
  2. Remove Jaeger from testing and test directly from the OpenTelemetry collector. When I was working on this, I saw that the tests would fail periodically when Jaeger was used as a backend, particularly for the service. Moving to OpenTelemetry collector only for the backend resolved this
  3. Shorten the retry interval from 10s to 5s in the tracetest server provisioning.

This should help speed up going from an Approved PR to getting it merged, as waiting for a 10+ minute check to complete can lead to context switching.

Merge Requirements

For new features contributions please make sure you have completed the following
essential items:

  • CHANGELOG.md updated to document new feature additions
    * [ ] Appropriate documentation updates in the docs
    * [ ] Appropriate Helm chart updates in the helm-charts

Maintainers will not merge until the above have been completed. If you're unsure
which docs need to be changed ping the
@open-telemetry/demo-approvers.

@puckpuck puckpuck requested a review from a team July 4, 2024 12:57
@github-actions github-actions bot added the helm-update-required Requires an update to the Helm chart when released label Jul 4, 2024
@puckpuck puckpuck removed the helm-update-required Requires an update to the Helm chart when released label Jul 4, 2024
Copy link
Member

@julianocosta89 julianocosta89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great improvement! 🚀

@github-actions github-actions bot added the helm-update-required Requires an update to the Helm chart when released label Jul 8, 2024
Copy link
Contributor

@rogercoll rogercoll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for decoupling the tests from the main compose file too

@puckpuck puckpuck merged commit 62d1d9b into open-telemetry:main Jul 8, 2024
30 checks passed
@puckpuck puckpuck deleted the tests.optimize-tracetest branch July 8, 2024 17:06
eliasmueller pushed a commit to UST-DeMAF/opentelemetry-demo that referenced this pull request Jul 14, 2024
* optimize trace testing

* run trace based tests concurrently

* fix lint failures

---------

Co-authored-by: Juliano Costa <julianocosta89@outlook.com>
ahealy-newr pushed a commit to ahealy-newr/opentelemetry-demo-ahealy that referenced this pull request Jul 24, 2024
* optimize trace testing

* run trace based tests concurrently

* fix lint failures

---------

Co-authored-by: Juliano Costa <julianocosta89@outlook.com>
CharlieTLe added a commit to CharlieTLe/opentelemetry.io that referenced this pull request Sep 8, 2024
Optimizations on trace-based testing in open-telemetry/opentelemetry-demo#1659 changed how tracetest is enabled. This change updates the documentation to reflect on enabling trace based tests should be done.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
helm-update-required Requires an update to the Helm chart when released
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants