Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expanded Self-Query Retriever and Self-Query Retriever with MyScale #2

Merged
merged 12 commits into from
Jun 14, 2023
Merged

Expanded Self-Query Retriever and Self-Query Retriever with MyScale #2

merged 12 commits into from
Jun 14, 2023

Conversation

mpskex
Copy link

@mpskex mpskex commented Jun 13, 2023

Expanded Self-Query Retriever 👀 and Self-querying with MyScale 🤩

LangChain built with a great interface for self-query retrievers and many super nice contribution has been made during the last few weeks. 🌟 Self-query retrievers are really cool and we believe it will be the future of vector databases! 😎 So we decided to expand self-query retriever with more functions and data types enabled and bring MyScale to the big family of self-query enabled vector databases! 🤗

MyScale can make use of various data types and functions for filters. It will boost up your LLM app no matter if you are scaling up your data or expand your system to broader application. 🚀🚀🚀 And we believe it will be a common feature to every vector database in the future!

In the notebook we'll demo the SelfQueryRetriever wrapped around a MyScale vector store with some extra piece we contributed to LangChain. In short, it can be concluded into 4 points:

  1. Add contain comparator 🪣 to match list of any if there is more than one element matched
  2. Add timestamp data type 🕰️ for date time match (ISO-format, or YYYY-MM-DD)
  3. Add like comparator 🔎 for string pattern search
  4. Add arbitrary function 💣 capability.

Let's boost LLM apps with vector databases! 🎉🎉🎉

Before submitting

  • unit-test for LIKE and CONTAIN
  • Notebook for MyScale Self-query Retriever

Who can review?

Tag maintainers/contributors who might be interested:

"id": "83811610-7df3-4ede-b268-68a6a83ba9e2",
"metadata": {},
"source": [
"In this tutorial we follow other example's setting and use `OpenAIEmbeddings`. Remember to get a OpenAI API Key for valid accesss to LLMs."
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

考虑加一句:visit myscale.com and sign up for free to get username and password for your myscale pod.

Copy link

@melovy melovy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mpskex mpskex merged commit 33f122f into myscale:master Jun 14, 2023
mpskex pushed a commit that referenced this pull request Oct 16, 2023
Dependency and import fixes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants