/AWS1/CL_BDKAUTOMATEDEVALCFG

The configuration details of an automated evaluation job. The EvaluationDatasetMetricConfig object is used to specify the prompt datasets, task type, and metric names.

CONSTRUCTOR

IMPORTING

Required arguments:

it_datasetmetricconfigs TYPE /AWS1/CL_BDKEVALDSMETRICCONFIG=>TT_EVALDATASETMETRICCONFIGS TT_EVALDATASETMETRICCONFIGS

Configuration details of the prompt datasets and metrics you want to use for your evaluation job.

Optional arguments:

io_evaluatormodelconfig TYPE REF TO /AWS1/CL_BDKEVALUATORMODELCFG /AWS1/CL_BDKEVALUATORMODELCFG

Contains the evaluator model configuration details. EvaluatorModelConfig is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.

io_custommetricconfig TYPE REF TO /AWS1/CL_BDKAUTOMATEDEVALCUS00 /AWS1/CL_BDKAUTOMATEDEVALCUS00

Defines the configuration of custom metrics to be used in an evaluation job.

---

Queryable Attributes

datasetMetricConfigs

Configuration details of the prompt datasets and metrics you want to use for your evaluation job.

Accessible with the following methods

Method	Description
GET_DATASETMETRICCONFIGS()	Getter for DATASETMETRICCONFIGS, with configurable default
ASK_DATASETMETRICCONFIGS()	Getter for DATASETMETRICCONFIGS w/ exceptions if field has n
HAS_DATASETMETRICCONFIGS()	Determine if DATASETMETRICCONFIGS has a value

evaluatorModelConfig

Contains the evaluator model configuration details. EvaluatorModelConfig is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.

Accessible with the following methods

Method	Description
GET_EVALUATORMODELCONFIG()	Getter for EVALUATORMODELCONFIG

customMetricConfig

Defines the configuration of custom metrics to be used in an evaluation job.

Accessible with the following methods

Method	Description
GET_CUSTOMMETRICCONFIG()	Getter for CUSTOMMETRICCONFIG