Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve slow CI #2061

Open
13 tasks
tdejager opened this issue Sep 17, 2024 · 0 comments
Open
13 tasks

Improve slow CI #2061

tdejager opened this issue Sep 17, 2024 · 0 comments
Labels
✨ enhancement Feature request 👩‍💻 cli Issue related to CLI

Comments

@tdejager
Copy link
Contributor

tdejager commented Sep 17, 2024

Problem description

When working and contributing to pixi the CI can be pretty slow. This is because of a number of factors, but I believe we can do some architectual changes to improve.

My idea is mainly to improve pipelining where a single platform can continue its tests without needing to wait on other platforms, while this does not improve the total pipeline speed it would give quicker feedback for the faster platforms. Currently the tests need to wait on all the platforms to be built for example.

Enable better pipelining:

  • Use composite actions for the build tasks. So that these can be re-used.
  • Make the integration-tests, wheel-tests, and downstream-tests a composite action as well.
  • Write out all the pipelines, instead of using matrices, so that we can depend on specific architectures.
  • Make the tests a step that is run after the rust compile (this step enables the actual pipelining)
  • Make use of nextest archive so that we skip the test compilation.

Other improvements:

Convert to pytest, similar to wheel tests:

  • Running examples
  • Integration tests

We can transform these tasks into specific issues when needed.

@tdejager tdejager added ✨ enhancement Feature request 👩‍💻 cli Issue related to CLI labels Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
✨ enhancement Feature request 👩‍💻 cli Issue related to CLI
Projects
None yet
Development

No branches or pull requests

1 participant