Class OpenDILLM

Open DI representation of a LLM.

Inheritance

object

OpenDIBase

OpenDIAsset

OpenDILLM

Inherited Members

OpenDIAsset.DIDirectory

OpenDIAsset.DIDataSource

OpenDIAsset.DIDataReader

OpenDIAsset.DIDataWriter

OpenDIAsset.parent

OpenDIAsset.fullPathName

OpenDIAsset.ownerType

OpenDIAsset.ownerID

OpenDIAsset.ToDTO<T>()

OpenDIAsset.Create(WMAssetBase)

OpenDIAsset.GetOwnerID()

OpenDIAsset.GetOwnerType()

OpenDIBase.openDIVersion

OpenDIBase.FQNSeparator

OpenDIBase.id

OpenDIBase.name

OpenDIBase.summary

OpenDIBase.documentation

OpenDIBase.documentationMIMEType

OpenDIBase.properties

OpenDIBase.GetWMType(string)

OpenDIBase.GetOpenDIType(Type)

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Quantellia.WMServer.OpenDI

Assembly: WMServer.dll

Syntax

public class OpenDILLM : OpenDIAsset

Constructors

OpenDILLM()

Default constructor

Declaration

public OpenDILLM()

OpenDILLM(WMLLM)

Constructor that initializes a new instance with the data from a WMLLM object.

Declaration

public OpenDILLM(WMLLM asset)

Parameters

Type	Name	Description
WMLLM	asset	The asset with which to initialize this OpenDILLM

Properties

APIKey

The API Key granting the user access to this LLM.

Declaration

public string APIKey { get; set; }

Property Value

Type	Description
string

LLMType

The type of LLM in use (i.e. ChatGPT, Gemini, etc...)

Declaration

public string LLMType { get; set; }

Property Value

Type	Description
string

MaxRecords

The maximum number of records to return in VectorDB queries.

Declaration

public int MaxRecords { get; set; }

Property Value

Type	Description
int

MaxTokens

The MaxTokens parameter of the model.

Declaration

public int? MaxTokens { get; set; }

Property Value

Type	Description
int?

ModelName

The name of the model in use.

Declaration

public string? ModelName { get; set; }

Property Value

Type	Description
string

Overlap

The maximum number of messages to include when calculating the context vector for RAG

Declaration

public int Overlap { get; set; }

Property Value

Type	Description
int

Prompt

The system prompt determining the behavior of this LLM.

Declaration

public string Prompt { get; set; }

Property Value

Type	Description
string

Temperature

The temperature parameter of the model.

Declaration

public float? Temperature { get; set; }

Property Value

Type	Description
float?

Threshold

The minimum similarity required for RAG to be used.

Declaration

public float Threshold { get; set; }

Property Value

Type	Description
float

Tools

The Tools used by the model. Note, Tools refers to a method with a description made available to the model. If a Tool "GetTimeZone()" has description "Returns the timezone of the user" and the LLM determines that it needs the user's timezone to answer a question, it will request the execution of "GetTimeZone()", and format its answer based on the return value.

Declaration

public string? Tools { get; set; }

Property Value

Type	Description
string

VectorIndexType

The type of VectorIndex in use. (i.e. WMNativeVectorIndex, PineconeVectorIndex, etc...)

Declaration

public string VectorIndexType { get; set; }

Property Value

Type	Description
string

WindowSize

The maximum characters to include in each window when calculating embeddings.

Declaration

public int WindowSize { get; set; }

Property Value

Type	Description
int

Methods

ToDTO()

Create a new WMLLMDTO object that contains the properties of this OpenDILLM

Declaration

public WMLLMDTO ToDTO()

Returns

Type	Description
WMLLMDTO	A WMLLMDTO object that contains the properties of this OpenDILLM