Discussions

• 1 You must be logged in to vote

  🙏

  How to count consumed and inferred tokens?

  lostmsu asked Sep 16, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there a way to have the LLM timeout or to cancel a request before the LLM starts to respond?

  nicholusi2021 asked Aug 29, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  💬

  BatchedExecutor: The only sane executor.

  follyfoxe started Jun 27, 2024 in General

  

  

  

  

  19
• 1 You must be logged in to vote

  🙏

  LLaVA-NeXT is not supported ?

  micoraweb asked Aug 11, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Support for Mini CPM models

  micoraweb asked Aug 7, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Coding Assistant Model

  aezendc asked Aug 6, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  RAG examples ? LLamasharp + langchain.net/kernel-memory?

  markat1 asked Jul 30, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Different model output during debugging and from the console

  aropb asked Jul 29, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  📣

  0.14.0 - Gemma2

  martindevans announced Jul 16, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  🙏

  Where should I put GGUF file? - WPF/avalonia UI application

  markat1 asked Jul 4, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Question about LLamaSharp's Dependency on llama.cpp Updates

  sangyuxiaowu asked Jun 28, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Reason for higher VRAM use than base library?

  SerialKicked asked Jun 23, 2024 in Q&A · Unanswered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Question on how to work with ChatSession and KernelMemory together

  nicholusi2021 asked Jun 13, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How do we handle prompt formatting?

  NeedsLoomis asked Mar 1, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💡

  It would be good if Executors did not at [end of text] or \n> at the end of the inference

  clovisribeiro started Mar 7, 2024 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to handle context overflow with Interactive/Instruct Executors

  ksanman asked May 1, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Does LLamaSharp expose llama.cpp's finetuning functionality?

  ErectableSentry asked Apr 28, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  💬

  Simplified llama.dll

  JohnClaw started Apr 20, 2024 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  BatchedExecutor Discussion

  martindevans started Mar 3, 2024 in General

  

  

  5
• 1 You must be logged in to vote

  💬

  LlamaSharp won't run on legacy NET Framework 4.8

  clovisribeiro started Mar 7, 2024 in General

  

  

  10
• 2 You must be logged in to vote

  📣

  0.10.0 - Phi2

  martindevans announced Feb 15, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  💬

  .Net 8 is broken

  chuckbeasley started Feb 6, 2024 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does this project support Vector DB search and send to (local) LLM to generate answers?

  orchardc asked Sep 27, 2023 in Q&A · Unanswered

  

  

  

  

  2
• 2 You must be logged in to vote

  🙌

  My C# ChatGPT clone built with Blazor WebAssembly, SignalR, and WebAPI and fluentUI that mirrors chatGPT's functionality when it launched.

  llamasaresavager started Dec 6, 2023 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  💬

  Batched Decoding

  martindevans started Nov 2, 2023 in General

  

  

  1