Builder

The name of the batch evaluation. Must be unique within your account.

A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, the service ignores the request, but does not return an error.

The data source configuration that specifies where to pull agent session traces from for evaluation.

The description of the batch evaluation.

Optional metadata for the evaluation, including session-specific ground truth data and test scenario identifiers.

The list of evaluators to apply during the batch evaluation. Can include both built-in evaluators and custom evaluators. Maximum of 10 evaluators.