Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: getting started #589

Merged
merged 13 commits into from
Feb 17, 2024
Merged

Conversation

jjmachan
Copy link
Member

No description provided.

Comment on lines 15 to 20
Additionally, you can use the RAG metrics with other Machine Learning Model (MLM) observability tools like
- [Langsmith](../howtos/integrations/langsmith.ipynb)
- [Phoenix (Arize)](https://github.com/Arize-ai/phoenix)
- [Langfuse](../howtos/integrations/langfuse.ipynb)
- [OpenLayer](https://openlayer.com/)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are there anymore we can add to this list - ideally we can point them to our integrations page

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, pointing to the integration page would be ideal

@jjmachan jjmachan marked this pull request as ready for review February 16, 2024 02:43
@jjmachan
Copy link
Member Author

added emojies
image

is that too much?

docs/getstarted/testset_generation.md Outdated Show resolved Hide resolved
docs/getstarted/monitoring.md Outdated Show resolved Hide resolved
docs/getstarted/evaluation.md Outdated Show resolved Hide resolved

Welcome to the ragas quickstart. We're going to get you up and running with ragas as quickly as you can so that you can go back to improving your Retrieval Augmented Generation pipelines while this library makes sure your changes are improving your entire pipeline.
Once your test set is ready (whether you've created your own or used the [synthetic test set generation module](get-started-testset-generation)), it's time to evaluate your RAG pipeline. Our aim is to help you set up with Ragas as quickly as possible so that you can focus on enhancing your Retrieval Augmented Generation pipelines while this library ensures your changes are improving the entire pipeline.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a mistake?

while this library ensures your changes are improving the entire pipeline.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nope, its correct i think

docs/getstarted/evaluation.md Outdated Show resolved Hide resolved
Comment on lines +28 to +37
async def fix_doc_with_llm(doc: File, llm: BaseChatModel) -> File:
prompt = """\
fix the following grammar and spelling mistakes in the following text.
Please keep the markdown format intact when reformating it.
Do not make any change to the parts of text that are for formating or additional metadata for the core text in markdown.
The target audience for this is developers so keep the tone serious and to the point without any marketing terms.
The output text should me in .md format.

text: {text}
"""
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added a script that helps review docs too

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've noticed that gpt4 actually helps a lot in keeping the tone professional and consistent.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

but I don't think the prompt is proper - can be improved

@shahules786 shahules786 merged commit 2235ee9 into explodinggradients:main Feb 17, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants