feat(sdk): support dynamic machine type parameters in pipeline task setters #11097

Signed-off-by: KevinGrantLee <kglee@google.com>

* feat(backend): move comp logic to workflow params Signed-off-by: zazulam <m.zazula@gmail.com> Co-authored-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu> Co-authored-by: MonicaZhang1 <zhangmonica1@gmail.com> Co-authored-by: kylekaminky <kyle.kaminky@gmail.com> Co-authored-by: CarterFendley <carter.fendley@gmail.com> Signed-off-by: zazulam <m.zazula@gmail.com> * address pr comments Signed-off-by: zazulam <m.zazula@gmail.com> * Use function name instead of base name and address edge cases Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: zazulam <m.zazula@gmail.com> * Improve logic and update tests Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: zazulam <m.zazula@gmail.com> * POC hashing command and args Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: zazulam <m.zazula@gmail.com> * Add comments to clarify the logic Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: zazulam <m.zazula@gmail.com> * Hash entire PipelineContainerSpec Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: zazulam <m.zazula@gmail.com> --------- Signed-off-by: zazulam <m.zazula@gmail.com> Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu> Co-authored-by: MonicaZhang1 <zhangmonica1@gmail.com> Co-authored-by: kylekaminky <kyle.kaminky@gmail.com> Co-authored-by: CarterFendley <carter.fendley@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 660985413 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 661332120 Signed-off-by: KevinGrantLee <kglee@google.com>

…red Data pipelines Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 661475667 Signed-off-by: KevinGrantLee <kglee@google.com>

…k_size in preview.custom_job.utils.create_custom_training_job_from_component Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 662242688 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Giulio Frasca <gfrasca@redhat.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: vmudadla <vmudadla@redhat.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Liav Weiss (EXT-Nokia) <liav.weiss.ext@nokia.com> Co-authored-by: Liav Weiss (EXT-Nokia) <liav.weiss.ext@nokia.com> Signed-off-by: KevinGrantLee <kglee@google.com>

* fix(frontend): retrieve archived logs from correct location Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu> Co-authored-by: owmasch <owenmaschal0598@gmail.com> * Add namespace tag handling and validation Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu> Co-authored-by: owmasch <owenmaschal0598@gmail.com> * Remove whitespace from keyFormat Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu> Co-authored-by: owmasch <owenmaschal0598@gmail.com> * Update frontend unit tests Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> * Remove superfluous log statements Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: quinnovator <jack@jq.codes> * Add link to keyFormat in manifests Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> * Fix workflow parsing for log artifact Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: quinnovator <jack@jq.codes> * Fix unit test Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> --------- Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu> Co-authored-by: owmasch <owenmaschal0598@gmail.com> Co-authored-by: quinnovator <jack@jq.codes> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 663774557 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 663872006 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 663883139 Signed-off-by: KevinGrantLee <kglee@google.com>

* Fail fast when image build fails on tests #11102 Signed-off-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> * Fail fast when image build fails on tests #11102 Signed-off-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> --------- Signed-off-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> Co-authored-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> Signed-off-by: KevinGrantLee <kglee@google.com>

… models only, use target_field_name for gemini models Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 665638487 Signed-off-by: KevinGrantLee <kglee@google.com>

…11126) Signed-off-by: hbelmiro <helber.belmiro@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

* Fixing incorrect typing in loop_parallism example Signed-off-by: Oswaldo Gomez <oswaldo.gomez@roche.com> * Fixing samples/core/loop_parameter example Signed-off-by: Oswaldo Gomez <oswaldo.gomez@roche.com> * Fixing aggregate-to-kubeflow-pipelines-edit Signed-off-by: Oswaldo Gomez <oswaldo.gomez@roche.com> * keeping MRs separate. Signed-off-by: Oswaldo Gomez <oswaldo.gomez@roche.com> * Adding blank line Signed-off-by: Oswaldo Gomez <oswaldo.gomez@roche.com> --------- Signed-off-by: Oswaldo Gomez <oswaldo.gomez@roche.com> Co-authored-by: Oswaldo Gomez <oswaldo.gomez@roche.com> Signed-off-by: KevinGrantLee <kglee@google.com>

…diction's output as per the output schema of model used Signed-off-by: Googler <nobody@google.com> PiperOrigin-RevId: 665977093 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Jason Dai <jsndai@google.com> PiperOrigin-RevId: 666102687 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: ddalvi <ddalvi@redhat.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Diego Lovison <diegolovison@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Giulio Frasca <gfrasca@redhat.com> Signed-off-by: KevinGrantLee <kglee@google.com>

… EmptyDir (#10913) Update kfp backend and kubernetes sdk to support mounting EmptyDir volumes to task pods. Inspired by #10427 Fixes: #10656 Signed-off-by: Greg Sheremeta <gshereme@redhat.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Fiona Waters <fiwaters6@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

…tegration-test (#11132) Bumps [micromatch](https://github.com/micromatch/micromatch) from 4.0.5 to 4.0.8. - [Release notes](https://github.com/micromatch/micromatch/releases) - [Changelog](https://github.com/micromatch/micromatch/blob/4.0.8/CHANGELOG.md) - [Commits](micromatch/micromatch@4.0.5...4.0.8) --- updated-dependencies: - dependency-name: micromatch dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Diego Lovison <diegolovison@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

…bleshooting (#11098) Signed-off-by: hbelmiro <helber.belmiro@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Michael Hu <humichael@google.com> PiperOrigin-RevId: 668536503 Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: hbelmiro <helber.belmiro@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>

… anything in it. Fixes #10241 (#11096) * Filter pipeline text box shows error when typing anything in it #10241 Signed-off-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> * Filter pipeline text box shows error when typing anything in it #10241 Signed-off-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> --------- Signed-off-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> Co-authored-by: Elay Aharoni (EXT-Nokia) <elay.aharoni.ext@nokia.com> Signed-off-by: KevinGrantLee <kglee@google.com>

This change allows KFP UI to fallback to UI host namespace when no namespaces are provided when referencing the artifact object store provider secret, in default kubeflow deployments this namespace is simply "kubeflow", however the user can customize this behavior by providing the environment variable "SERVER_NAMESPACE" to the KFP UI deployment. Further more, this change addresses a bug that caused URL parse to fail when parsing endpoints without a protocol, this will support such endpoint types as <ip>:<port> for object store endpoints, as is the case in the default kfp deployment manifests. Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> Signed-off-by: KevinGrantLee <kglee@google.com>

Signed-off-by: Helber Belmiro <helber.belmiro@gmail.com> Signed-off-by: KevinGrantLee <kglee@google.com>