add tutuorial for RAG of openai and bedrock #2975
Conversation
ylwu-amzn
requested review from
b4sjoo,
dhrubo-os,
jngz-es,
model-collapse,
rbhavna,
zane-neo,
Zhangxunmt,
austintlee,
HenryL27,
samuel-oci and
xinyual
as code owners
ylwu-amzn
temporarily deployed
to
ml-commons-cicd-env
GitHub Actions
Inactive
ylwu-amzn
temporarily deployed
to
ml-commons-cicd-env
GitHub Actions
Inactive
Signed-off-by: Yaliang Wu <ylwu@amazon.com>
ylwu-amzn
temporarily deployed
to
ml-commons-cicd-env
GitHub Actions
Inactive
ylwu-amzn
had a problem deploying
to
ml-commons-cicd-env
GitHub Actions
Failure
| "ext": { | ||
| "generative_qa_parameters": { | ||
| "llm_model": "bedrock/claude", | ||
| "llm_question": "What's the population increase of New York City from 2021 to 2023?", |
There was a problem hiding this comment.
Is it a required parameter here? Why don't we use the content of query?
There was a problem hiding this comment.
Yes llm_question is mandatory , check this doc https://opensearch.org/docs/latest/search-plugins/conversational-search/
This is the feature's design. Some query may have no the content or have different query with the question.
| "ext": { | ||
| "generative_qa_parameters": { | ||
| "llm_model": "bedrock/claude", | ||
| "llm_question": "What's the population increase of New York City from 2021 to 2023?", |
There was a problem hiding this comment.
Since this is a conversational search, can you try a follow up question to demo this is an on-going conversation? Maybe we can try another questions like "based on the population increased in New York, is it the fastest growing city in the world?", or other follow up questions.
There was a problem hiding this comment.
make sense, will add a following up question
| "_id": "2", | ||
| "_score": 9.042081, | ||
| "_source": { | ||
| "text": "Chart and table of population level and growth rate for the New York City metro area from 1950 to 2023. United Nations population projections are also included through the year 2035.\\nThe current metro area population of New York City in 2023 is 18,937,000, a 0.37% increase from 2022.\\nThe metro area population of New York City in 2022 was 18,867,000, a 0.23% increase from 2021.\\nThe metro area population of New York City in 2021 was 18,823,000, a 0.1% increase from 2020.\\nThe metro area population of New York City in 2020 was 18,804,000, a 0.01% decline from 2019." |
There was a problem hiding this comment.
same comments, wanting to see more queries to demo the conversational features.
Description
Add tutorial for RAG of OpenAI and bedrock
Related Issues
Resolves #[Issue number to be closed when this PR is merged]
Check List
--signoff.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.