Interface ILLMConversation

An interface implemented by all LLM conversation classes.

Namespace: Quantellia.WMServer.Asset.LLM

Assembly: WMServer.dll

Syntax

public interface ILLMConversation

Properties

ConversationID

The ID of this conversation

Declaration

string ConversationID { get; set; }

Property Value

Type	Description
string

Methods

GetRetrievalAugmentedMessage(WMPrincipal, string, WMAppDbContext)

Modifies a message with contextual information

Declaration

Task<string> GetRetrievalAugmentedMessage(WMPrincipal principal, string message, WMAppDbContext context)

Parameters

Type	Name	Description
WMPrincipal	principal
string	message
WMAppDbContext	context

Returns

Type	Description
Task<string>

StreamConversation(WMPrincipal, ConversationArgs, bool, WMAppDbContext)

Interfaces with the LLM provider, sends the provided message and writes the responses to the HTTPResponse as they arrive. If streamResultsAsTheyCome = true, after each response is written the HTTPResponse body stream flushes its contents to the receiver.

Declaration

IAsyncEnumerable<ILLMConversation.Response> StreamConversation(WMPrincipal principal, ConversationArgs args, bool streamResultsAsTheyCome, WMAppDbContext context)

Parameters

Type	Name	Description
WMPrincipal	principal
ConversationArgs	args	The message args to send
bool	streamResultsAsTheyCome	Whether the response body stream should be flushed whenever a response is written
WMAppDbContext	context

Returns

Type	Description
IAsyncEnumerable<ILLMConversation.Response>

ToDatabaseRecord(WMPrincipal)

Populates a WMLLMConversationRecord with all of the messages that have been exchanged, any necessary metadata, and return the resulting record for journaling.

Declaration

Task<WMLLMConversationRecord> ToDatabaseRecord(WMPrincipal principal)

Parameters

Type	Name	Description
WMPrincipal	principal

Returns

Type	Description
Task<WMLLMConversationRecord>