/AWS1/CL_QQCAIPRINFERENCECONF¶
The configuration for inference parameters when using AI Prompts.
CONSTRUCTOR¶
IMPORTING¶
Optional arguments:¶
iv_temperature TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING¶
The temperature setting for controlling randomness in the generated response.
iv_topp TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING¶
The top-P sampling parameter for nucleus sampling.
iv_topk TYPE /AWS1/QQCTOPK /AWS1/QQCTOPK¶
The top-K sampling parameter for token selection.
iv_maxtokenstosample TYPE /AWS1/QQCMAXTOKENSTOSAMPLE /AWS1/QQCMAXTOKENSTOSAMPLE¶
The maximum number of tokens to generate in the response.
Queryable Attributes¶
temperature¶
The temperature setting for controlling randomness in the generated response.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TEMPERATURE() |
Getter for TEMPERATURE, with configurable default |
ASK_TEMPERATURE() |
Getter for TEMPERATURE w/ exceptions if field has no value |
STR_TEMPERATURE() |
String format for TEMPERATURE, with configurable default |
HAS_TEMPERATURE() |
Determine if TEMPERATURE has a value |
topP¶
The top-P sampling parameter for nucleus sampling.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TOPP() |
Getter for TOPP, with configurable default |
ASK_TOPP() |
Getter for TOPP w/ exceptions if field has no value |
STR_TOPP() |
String format for TOPP, with configurable default |
HAS_TOPP() |
Determine if TOPP has a value |
topK¶
The top-K sampling parameter for token selection.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TOPK() |
Getter for TOPK, with configurable default |
ASK_TOPK() |
Getter for TOPK w/ exceptions if field has no value |
HAS_TOPK() |
Determine if TOPK has a value |
maxTokensToSample¶
The maximum number of tokens to generate in the response.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MAXTOKENSTOSAMPLE() |
Getter for MAXTOKENSTOSAMPLE, with configurable default |
ASK_MAXTOKENSTOSAMPLE() |
Getter for MAXTOKENSTOSAMPLE w/ exceptions if field has no v |
HAS_MAXTOKENSTOSAMPLE() |
Determine if MAXTOKENSTOSAMPLE has a value |