Fixed up Max Mutual information example

[ivanleomk]

🚀	This description was created by Ellipsis for commit 5358961

Summary:

Updated docs/prompting/ensembling/max_mutual_information.md with detailed explanation, formulas, and Python implementation example for Max Mutual Information method.

Key points:

• Updated docs/prompting/ensembling/max_mutual_information.md with a detailed explanation of the Max Mutual Information method.
• Added sections explaining entropy and mutual information with relevant formulas.
• Included a Python implementation example using OpenAI's API to demonstrate the method.
• Provided two prompt templates (prompt_template_1 and prompt_template_2) for comparison.
• Added functions generate_response, generate_responses, calculate_entropy, and calculate_mutual_information to compute and compare mutual information scores.
• Included example queries and results to illustrate the selection of the best prompt template.

---

Generated with ❤️ by ellipsis.dev

[ellipsis-dev]

❌ Changes requested. Reviewed everything up to e76e619 in 30 seconds

More details

• Looked at 270 lines of code in 1 files
• Skipped 1 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_0IXi8nKOi8ydGQyI

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

The new markdown file max_mutual_information.md should be added to mkdocs.yml to ensure it is included in the site navigation.

[cloudflare-workers-and-pages]

Deploying instructor with    Cloudflare Pages

Latest commit:	5358961
Status:	✅  Deploy successful!
Preview URL:	https://dcd2ec12.instructor.pages.dev
Branch Preview URL:	https://max-mutual.instructor.pages.dev

View logs

[ellipsis-dev]

👍 Looks good to me! Incremental review on 5358961 in 38 seconds

More details

• Looked at 13 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 1 drafted comments based on config settings.

1. mkdocs.yml:256

• Draft comment:
  The navigation title for max_mutual_information.md has been changed to 'Use Ensembles To Test Prompts'. If the document specifically focuses on the Max Mutual Information method, consider reverting this to a more accurate title, such as 'Max Mutual Information'.

      - Max Mutual Information: 'prompting/ensembling/max_mutual_information.md'

• Reason this comment was not posted:
  Confidence of 0% on close inspection, compared to threshold of 85%.

Workflow ID: wflow_1V9pckpXEzO3qqyt

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[jxnl]

hard to imagine when this will ever be used unforch...

[ivanleomk]

hard to imagine when this will ever be used unforch...

I think unless you have the log probs, the implementation here is more of an example of LLM-as-a-judge to score different templates. I feel like this is just something to try but agree that few shot is going to give you much more mileage rather than messing around with prompts like this.