Version 4.0.4

This is an incremental bugfix release.

The main highlights are:

• Fix a bug in integrated luminosity plots #1442.
• Code for ancillary NNPDF 4.0 analysis (such as Hessian conversion #1344, Nf=4 re-evolution #1422, or alpha_s errors bundling #1340).
• User facing documentation, including for reproducibility of 4.0 the analysis (#1378)

Additional changes include:

• A bug in the evolution basis definition #1445, of no consequence to existing analyses was fixed (thanks to @msyan!).
• Enhancements to hyperoprimization allowing it to work on estimators depending on a full fit (#1316).
• Some work on moving features implemented in C++ to python (e.g. #1268).
• Tweaks and enhancements to various plotting functions, as well as new spider diagrams (#1194).
• Automation using Github Actions, to for example produce release Doceker images (#1390).

The full list of changes is included below.

What's Changed

New Features

• Improve varflavors script (#1422) @Zaharid
• Compute 1D luminosities with a rapidity cut (#1439) @enocera
• Add fit-based targets to hyperparameter optimization (#1316) @scarlehoff
• Speed up convolution (#1435) @scarlehoff
• Use internal cuts in tests with predictions (#1429) @scarlehoff
• Add integrability datasets for valence pdfs (#1412) @RoyStegeman
• adding --theory_id flag to evolven3fit (#1346) @scarrazza
• Add modified_tanh activation function (#1411) @RoyStegeman
• Add toggle to remove 68% legend labels (#1406) @Zaharid
• Improving reading and recreating fit pseudodata (#1328) @siranipour
• Adding spider plot for dataspecs groups (#1398) @siranipour
• Bump reportengine version (#1399) @Zaharid
• Saving new python pseudodata during fit (#1333) @siranipour
• Added separate theory for iterated K-factors (#1396) @enocera
• Hyperoptimization: take trials from a previous run (#1314) @scarlehoff
• Added scalar functions to plot d/u and dbar/ubar ratios (#1365) @enocera
• Adding action to bundle PDFs (#1340) @siranipour
• MC2Hessian in vp (#1348) @RoyStegeman
• General theory covmat (#991) @RosalynLP
• Create a hyperscan resource (#1313) @scarlehoff
• remove formatting of pdf scale in title - use default python format (#1327) @wilsonmr
• Making n3fit use python covmats (#1285) @siranipour
• impose_sumrules default setting (#1322) @RoyStegeman
• Modify vp-comparefits interface (#1312) @scarlehoff
• update matplotlib hatch style (#1317) @RoyStegeman
• At least 1d central values for t0 predictions (#1305) @siranipour
• Cleaner CommonData repr (#1310) @siranipour
• Plot higher mx data by default (#1308) @Zaharid
• Making n3fit use python pseudodata (#1268) @siranipour
• Allow the n3fit-vp interface to make use of more than 1 members (#1251) @scarlehoff
• Generate replicas when fitting models in parallel (#1261) @scarlehoff
• Create spider/radar diagram for comparing chi2s between fits (#1194) @RosalynLP

Bug fixes

• Fix bug in the definition of the 1D luminosity. (#1443) @enocera
• fixing T24 and V24 definition in vp (#1445) @tgiani
• Fix for smpdf (#1437) @scarlehoff
• Fixing training mask tables (#1423) @siranipour
• Collecting over cuts context for pseudodata (#1418) @siranipour
• Fix to check_cuts_considered (#1419) @scarlehoff
• Collect over groups to arrange groups_chi2 table (#1352) @siranipour
• Fix some problems in spider plots (#1389) @Zaharid
• Fix commodata loader bug (#1415) @RoyStegeman
• remove space at beggining of line in pdfas header (#1404) @RoyStegeman
• Fixed typo in PDF4LHC21 basis (#1393) @enocera
• fix default value in postfit help (#1391) @RoyStegeman
• Fix hyphotesis timeout (#1383) @scarlehoff
• Correcting kinematics override for DY datasets (#1357) @siranipour
• change header replica0 (#1342) @RoyStegeman
• Fix regressions by specifying dtype (#1336) @siranipour
• Recover overfit option for partitions (#1330) @scarlehoff
• Fixing memory leaks in buildmaster (#1300) @enocera
• Fixing buildmaster leaks round 2 (#1318) @scarrazza
• Correcting syntax in PLOTTING_POSDYU.yaml (#1307) @RosalynLP
• Fix potential bug in read_fit_pseudodata (#1249) @RosalynLP
• Make fitting theory covmat with indices aligned with experiment covmat (#1232) @RosalynLP
• Fix vp-deltachi2 by changing experiments to datasets inputs (#1292) @scarlehoff

Documentation

• Update resources for tests, examples and documentation to be NNPDF4.0 based (#1440) @scarlehoff
• Add warning on compatibility of Hessian sets (#1441) @Zaharid
• Fix make_replica example (#1425) @siranipour
• Fixing pseudodata tutorial (#1427) @siranipour
• Update git tutorial (#1431) @scarlehoff
• Add docs on how to do a future test (#1408) @scarlehoff
• Restructuring data kws docs (#1382) @siranipour
• update runcard names to agree with paper (#1402) @RoyStegeman
• Add compression tools to docs (#1395) @scarlehoff
• Temporarily remove nf=4 comment (#1401) @Zaharid
• Add sysroot to installation instruction (#1400) @Zaharid
• Refine wording on coding rules (#1387) @Zaharid
• Remove nnfit references (#1394) @scarlehoff
• Add documentation on compatibility policy (#1385) @Zaharid
• Write a publicly facing README (#1374) @Zaharid
• how to reproduce nnpdf40 fit - docs (#1378) @RoyStegeman
• Rephrasing docs frontpage /fixing typos (#1343) @RosalynLP
• Add dataset specification to runcard guide (#1379) @scarlehoff
• Create LICENSE (#1375) @scarrazza
• Docs code structure (#1368) @RoyStegeman
• restructured documentation (#1303) @mariaubiali
• Update runcards with latest choice of baseline data set (#1320) @enocera
• Add NNPDF4.0 conda environment (#1255) @Zaharid
• Remove authors from docs (#1304) @voisey
• Correct typos (#1301) @RosalynLP
• Removed reference to no longer existing data_layout file in doc (#1297) @enocera
• update LO runcards (#1296) @RoyStegeman

Workflow

• adding minimum setup for release drafter (#1447) @scarrazza
• updating tests for github actions (#1397) @scarrazza
• GitHub Packages for nnpdf (#1390) @scarrazza
• disable self-hosted runner for fit-bot (#1369) @scarrazza
• Add testing github action (#1363) @scarlehoff

Refactoring

• Revert correlated shift functionality (#1388) @Zaharid
• Delete validphys 1 (#1361) @Zaharid
• Remove unused class (#1350) @Zaharid
• Removing unused imports (#1338) @siranipour
• Delete old executables (#1283) @Zaharid

Full Changelog: 4.0.3...4.0.4