-
Notifications
You must be signed in to change notification settings - Fork 36
Open
Labels
cfp-runtimeCodeflare pipelines runtimeCodeflare pipelines runtimeenhancementNew feature or requestNew feature or requestuser-storyUser storyUser story
Description
Overview
Current implementation does not accept user specified scoring metric(s). For example,
cross_val_score(pipeline, X_test, y_test, scoring="neg_mean_squared_error", cv=10)
The list of sklearn model evaluation metrics are listed here
https://scikit-learn.org/stable/modules/model_evaluation.html#scoring-parameter
Acceptance Criteria
One common use case documented below is supported by codeflare pipeline.
https://scikit-learn.org/stable/auto_examples/model_selection/plot_underfitting_overfitting.html#sphx-glr-auto-examples-model-selection-plot-underfitting-overfitting-py
Questions
Assumptions
Reference
Metadata
Metadata
Assignees
Labels
cfp-runtimeCodeflare pipelines runtimeCodeflare pipelines runtimeenhancementNew feature or requestNew feature or requestuser-storyUser storyUser story