Class OpenDILLMConnection
Open DI representation of a LLM.
Inherited Members
Namespace: Quantellia.WMServer.OpenDI
Assembly: WMServer.dll
Syntax
public class OpenDILLMConnection : OpenDIAsset
Constructors
OpenDILLMConnection()
Default constructor
Declaration
public OpenDILLMConnection()
OpenDILLMConnection(WMLLMConnection)
Constructor that initializes a new instance with the data from a WMLLM object.
Declaration
public OpenDILLMConnection(WMLLMConnection asset)
Parameters
Type | Name | Description |
---|---|---|
WMLLMConnection | asset | The asset with which to initialize this OpenDILLM |
Properties
APIKey
The API Key granting the user access to this LLM.
Declaration
public string APIKey { get; set; }
Property Value
Type | Description |
---|---|
string |
LLMType
The type of LLM in use (i.e. ChatGPT, Gemini, etc...)
Declaration
public string LLMType { get; set; }
Property Value
Type | Description |
---|---|
string |
MaxRecords
The maximum number of records to return in VectorDB queries.
Declaration
public int MaxRecords { get; set; }
Property Value
Type | Description |
---|---|
int |
MaxTokens
The MaxTokens parameter of the model.
Declaration
public int? MaxTokens { get; set; }
Property Value
Type | Description |
---|---|
int? |
ModelName
The name of the model in use.
Declaration
public string? ModelName { get; set; }
Property Value
Type | Description |
---|---|
string |
Overlap
The maximum number of messages to include when calculating the context vector for RAG
Declaration
public int Overlap { get; set; }
Property Value
Type | Description |
---|---|
int |
Threshold
The minimum similarity required for RAG to be used.
Declaration
public float Threshold { get; set; }
Property Value
Type | Description |
---|---|
float |
VectorIndexType
The type of VectorIndex in use. (i.e. WMNativeVectorIndex, PineconeVectorIndex, etc...)
Declaration
public string VectorIndexType { get; set; }
Property Value
Type | Description |
---|---|
string |
WindowSize
The maximum characters to include in each window when calculating embeddings.
Declaration
public int WindowSize { get; set; }
Property Value
Type | Description |
---|---|
int |
Methods
ToDTO()
Create a new WMLLMConnectionDTO object that contains the properties of this OpenDILLMConnection
Declaration
public WMLLMConnectionDTO ToDTO()
Returns
Type | Description |
---|---|
WMLLMConnectionDTO | A WMLLMConnectionDTO object that contains the properties of this OpenDILLMConnection |