Class OpenDILLMConnection
Open DI representation of a LLM.
Inherited Members
Namespace: Quantellia.WMServer.OpenDI
Assembly: WMServer.dll
Syntax
public class OpenDILLMConnection : OpenDIAsset
Constructors
OpenDILLMConnection()
Default constructor
Declaration
public OpenDILLMConnection()
OpenDILLMConnection(WMLLMConnection)
Constructor that initializes a new instance with the data from a WMLLM object.
Declaration
public OpenDILLMConnection(WMLLMConnection asset)
Parameters
| Type | Name | Description |
|---|---|---|
| WMLLMConnection | asset | The asset with which to initialize this OpenDILLM |
Properties
APIKey
The API Key granting the user access to this LLM.
Declaration
public string? APIKey { get; set; }
Property Value
| Type | Description |
|---|---|
| string |
LLMType
The type of LLM in use (i.e. ChatGPT, Gemini, etc...)
Declaration
public string? LLMType { get; set; }
Property Value
| Type | Description |
|---|---|
| string |
MaxRecords
The maximum number of records to return in VectorDB queries.
Declaration
public int? MaxRecords { get; set; }
Property Value
| Type | Description |
|---|---|
| int? |
MaxTokens
The MaxTokens parameter of the model.
Declaration
public int? MaxTokens { get; set; }
Property Value
| Type | Description |
|---|---|
| int? |
ModelName
The name of the model in use.
Declaration
public string? ModelName { get; set; }
Property Value
| Type | Description |
|---|---|
| string |
Overlap
The maximum number of messages to include when calculating the context vector for RAG
Declaration
public int? Overlap { get; set; }
Property Value
| Type | Description |
|---|---|
| int? |
Threshold
The minimum similarity required for RAG to be used.
Declaration
public float? Threshold { get; set; }
Property Value
| Type | Description |
|---|---|
| float? |
VectorIndexType
The type of VectorIndex in use. (i.e. WMNativeVectorIndex, PineconeVectorIndex, etc...)
Declaration
public string? VectorIndexType { get; set; }
Property Value
| Type | Description |
|---|---|
| string |
WindowSize
The maximum characters to include in each window when calculating embeddings.
Declaration
public int? WindowSize { get; set; }
Property Value
| Type | Description |
|---|---|
| int? |
Methods
ToDTODefault()
Create a new IWMAssetBaseDTO object that contains the properties of this OpenDIAsset. Throws an exception if null values without default are encountered.
Declaration
public WMLLMConnectionDTO ToDTODefault()
Returns
| Type | Description |
|---|---|
| WMLLMConnectionDTO | A IWMAssetBaseDTO object that contains the properties (or default values) of this OpenDIAsset |
ToDTOPartial()
Create a new IWMAssetBaseDTO object that contains only the properties of this OpenDIAsset with no defaults.
Declaration
public WMLLMConnectionDTO ToDTOPartial()
Returns
| Type | Description |
|---|---|
| WMLLMConnectionDTO | A IWMAssetBaseDTO object that contains the properties of this OpenDIAsset |