Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow for parallelization in evolven3fit_new #408

Open
RoyStegeman opened this issue Aug 8, 2023 · 1 comment
Open

Allow for parallelization in evolven3fit_new #408

RoyStegeman opened this issue Aug 8, 2023 · 1 comment
Labels
enhancement New feature or request good first issue

Comments

@RoyStegeman
Copy link
Member

Currently evolven3fit_new evolves the PDFs sequentially both in Q2 and replicas. For many replicas this means that evolution can take up to several hours while even for the usual 100 replica fits it generally will take over 20 minutes for the evolution to complete.

Whenever resources are available (which they are on any clusters) it would be nice to have the option to parallelize parts of the the evolution to speed up the computation.

@RoyStegeman RoyStegeman added the enhancement New feature or request label Aug 8, 2023
@scarlehoff scarlehoff transferred this issue from NNPDF/nnpdf Sep 24, 2024
@scarlehoff
Copy link
Member

As per the discussion w @felixhekhorn, the necessary change here is for eko to allow for more than one replica at once. To first approximation it should be trivial (the EKO x PDF contraction should have one extra axis for the number of replicas).

Then of course the changes will need to be propagated to evolven3fit and there might also be collateral damage somewhere.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue
Projects
None yet
Development

No branches or pull requests

3 participants