.Net OpenAI - Add Usage information for Streaming #6826
Labels
ai connector
Anything related to AI connectors
Ignite
.NET
Issue or Pull requests regarding .NET code
Recently OpenAI added a
stream_options.include_usage = true
parameter that when set provide one last chunk with theUsage
information, this can be set on by default in our connector for text streaming APIs.https://platform.openai.com/docs/api-reference/chat/create#chat-create-stream_options
Last chunk info example
The text was updated successfully, but these errors were encountered: