-
Notifications
You must be signed in to change notification settings - Fork 129
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] Error using Bedrock connector for Claud V2 #2969
Comments
One mystery solved. If I add a sleep statement after loading the data and after creating the memory, then I get the same error as I get in dev tools:
|
Second mystery solved. I changed the definition of the search pipeline to use 'question_text' in the
Now I get this error
So it's correctly pulling the context. Looks like I need inputs. |
One more turn on this... it's confusing, I used the bedrock connector blueprint from here, but that one's wrong for conversational search. Anyway, there's no parameters.inputs there. So I changed the connector to look like the one on the docs page, by changing the request body to:
And the connector to
But that gives:
|
Hi @Jon-AtAWS ! You are receiving this error because model interface for
This response is formatted from |
According to https://github.com/opensearch-project/ml-commons/blob/2.x/docs/remote_inference_blueprints/bedrock_connector_anthropic_claude_blueprint.md, it is correct to require |
I found the root cause. The requests will be formatted from |
@Jon-AtAWS , I think you should use
|
@Jon-AtAWS I would suggest a quick workaround:
|
@Jon-AtAWS , resolved this issue as solution has provided. You can also check this tutorial PR #2975 |
What is the bug?
This query:
Gives the following error
I followed the documentation here: https://opensearch.org/docs/latest/search-plugins/conversational-search/ and created the following code:
How can one reproduce the bug?
Steps to reproduce the behavior:
The above code will reproduce the error. The data came from https://registry.opendata.aws/amazon-pqa/
What is the expected behavior?
I should get a text response from the model
What is your host/environment?
Do you have any screenshots?
N/A
Additional context
If I run the following in Dev Tools, I get a different error
The text was updated successfully, but these errors were encountered: