TunedModelTopK Property

Optional. For Top-k sampling. Top-k sampling considers the set of TopK most probable tokens. This value specifies default to be used by the backend while making the call to the model. This value specifies default to be the one used by the base model while creating the model.

Definition

Namespace: GenerativeAI.Types
Assembly: GenerativeAI (in GenerativeAI.dll) Version: 2.0.2+aa51399cad6d90cc71158d589a6268608b3c1893
C#
public int? TopK { get; set; }

Property Value

NullableInt32

See Also