Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Function Wrapper for LLM Features #1596

Open
Mephistic opened this issue Aug 18, 2024 · 0 comments
Open

Function Wrapper for LLM Features #1596

Mephistic opened this issue Aug 18, 2024 · 0 comments
Labels
backend Backend Development enhancement New feature or request

Comments

@Mephistic
Copy link
Collaborator

Mephistic commented Aug 18, 2024

Problem

Our codebase is written in Javascript/Typescript, but the LLM team does their data analysis and LLM queries in Python. We want them to continue to be able to write code in their language of choice (without compromising our language of choice), but we need to be able to call their LLM-based summary and tag generating functions in order to populate our firestore database.

To that end, we need to set up a framework to enable us to deploy Python Cloud function/s that can wrap the LLM team's summary/tag generators.

Success Criteria

  • Python-based Google Cloud Function (in the codeforboston/maple repo)
    • Wraps the existing LLM team code for Bill Summary and Bill Tag generation
    • BillSummary function has a contract like (BillId, BillText, SectionText) -> (BillSummary)
    • BillTag function has a contract like (BillId, BillText) -> [BillTags]
  • Functions should be internally-accessible only (e.g. only accessible from our other backend services)

Omissions

  • Actually acquiring the section text for Bill Summaries is out-of-scope for this ticket
  • This ticket doesn't cover the entire backend flow for generating and storing bill summaries - just the deployment of the cloud wrapper functions for the LLM code. Future tickets will build on this to queue up summary/tag generation requests and store the results in Firestore.

Additional Links

@Mephistic Mephistic added backend Backend Development enhancement New feature or request labels Aug 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Backend Development enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant