Support custom_image in update_inference_endpoint #2306
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fix #2301.
With
create_inference_endpoint
, it is possible to set a custom docker image to run in the Inference Endpoint (typically a TGI container). When adding this in #1861, I forgot to add it toupdate_inference_endpoint
. This PR fixes this for consistency. And also to save poor @datavistics regularly making bad dreams about it.