Skip to content

/AWS1/CL_BDCHARNLITELLMMODCFG

Configuration for a LiteLLM model provider, enabling connection to third-party model providers.

CONSTRUCTOR

IMPORTING

Required arguments:

iv_modelid TYPE /AWS1/BDCMODELID /AWS1/BDCMODELID

The LiteLLM model identifier (e.g., "anthropic/claude-3-sonnet").

Optional arguments:

iv_apikeyarn TYPE /AWS1/BDCAPIKEYARN /AWS1/BDCAPIKEYARN

The ARN of the API key in AgentCore Identity for authenticating with the model provider.

iv_apibase TYPE /AWS1/BDCHARNESSLITELLMAPIBASE /AWS1/BDCHARNESSLITELLMAPIBASE

The base URL for the model provider's API endpoint.

iv_maxtokens TYPE /AWS1/BDCMAXTOKENS /AWS1/BDCMAXTOKENS

The maximum number of tokens to allow in the generated response per iteration.

iv_temperature TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING

The temperature to set when calling the model.

iv_topp TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING

The topP set when calling the model.

io_additionalparams TYPE REF TO /AWS1/CL_RT_DOCUMENT /AWS1/CL_RT_DOCUMENT

Provider-specific parameters passed through to the model provider unchanged.


Queryable Attributes

modelId

The LiteLLM model identifier (e.g., "anthropic/claude-3-sonnet").

Accessible with the following methods

Method Description
GET_MODELID() Getter for MODELID, with configurable default
ASK_MODELID() Getter for MODELID w/ exceptions if field has no value
HAS_MODELID() Determine if MODELID has a value

apiKeyArn

The ARN of the API key in AgentCore Identity for authenticating with the model provider.

Accessible with the following methods

Method Description
GET_APIKEYARN() Getter for APIKEYARN, with configurable default
ASK_APIKEYARN() Getter for APIKEYARN w/ exceptions if field has no value
HAS_APIKEYARN() Determine if APIKEYARN has a value

apiBase

The base URL for the model provider's API endpoint.

Accessible with the following methods

Method Description
GET_APIBASE() Getter for APIBASE, with configurable default
ASK_APIBASE() Getter for APIBASE w/ exceptions if field has no value
HAS_APIBASE() Determine if APIBASE has a value

maxTokens

The maximum number of tokens to allow in the generated response per iteration.

Accessible with the following methods

Method Description
GET_MAXTOKENS() Getter for MAXTOKENS, with configurable default
ASK_MAXTOKENS() Getter for MAXTOKENS w/ exceptions if field has no value
HAS_MAXTOKENS() Determine if MAXTOKENS has a value

temperature

The temperature to set when calling the model.

Accessible with the following methods

Method Description
GET_TEMPERATURE() Getter for TEMPERATURE, with configurable default
ASK_TEMPERATURE() Getter for TEMPERATURE w/ exceptions if field has no value
STR_TEMPERATURE() String format for TEMPERATURE, with configurable default
HAS_TEMPERATURE() Determine if TEMPERATURE has a value

topP

The topP set when calling the model.

Accessible with the following methods

Method Description
GET_TOPP() Getter for TOPP, with configurable default
ASK_TOPP() Getter for TOPP w/ exceptions if field has no value
STR_TOPP() String format for TOPP, with configurable default
HAS_TOPP() Determine if TOPP has a value

additionalParams

Provider-specific parameters passed through to the model provider unchanged.

Accessible with the following methods

Method Description
GET_ADDITIONALPARAMS() Getter for ADDITIONALPARAMS, with configurable default
ASK_ADDITIONALPARAMS() Getter for ADDITIONALPARAMS w/ exceptions if field has no va
HAS_ADDITIONALPARAMS() Determine if ADDITIONALPARAMS has a value