/AWS1/CL_BDCEVALREFERENCEINPUT¶
A reference input containing ground truth data for evaluation, scoped to a specific context level (session or trace) through its span context.
CONSTRUCTOR¶
IMPORTING¶
Required arguments:¶
io_context TYPE REF TO /AWS1/CL_BDCCONTEXT /AWS1/CL_BDCCONTEXT¶
The contextual information associated with an evaluation, including span context details that identify the specific traces and sessions being evaluated within the agent's execution flow.
Optional arguments:¶
io_expectedresponse TYPE REF TO /AWS1/CL_BDCEVALUATIONCONTENT /AWS1/CL_BDCEVALUATIONCONTENT¶
The expected response for trace-level evaluation. Built-in evaluators that support this field compare the agent's actual response against this value for assessment. Custom evaluators can access it through the
{expected_response}placeholder in their instructions.
it_assertions TYPE /AWS1/CL_BDCEVALUATIONCONTENT=>TT_EVALUATIONCONTENTLIST TT_EVALUATIONCONTENTLIST¶
A list of assertion statements for session-level evaluation. Each assertion describes an expected behavior or outcome the agent should demonstrate during the session.
io_expectedtrajectory TYPE REF TO /AWS1/CL_BDCEVALEXPECTEDTRAJ00 /AWS1/CL_BDCEVALEXPECTEDTRAJ00¶
The expected tool call sequence for session-level trajectory evaluation. Contains a list of tool names representing the tools the agent is expected to invoke.
Queryable Attributes¶
context¶
The contextual information associated with an evaluation, including span context details that identify the specific traces and sessions being evaluated within the agent's execution flow.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_CONTEXT() |
Getter for CONTEXT |
expectedResponse¶
The expected response for trace-level evaluation. Built-in evaluators that support this field compare the agent's actual response against this value for assessment. Custom evaluators can access it through the
{expected_response}placeholder in their instructions.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_EXPECTEDRESPONSE() |
Getter for EXPECTEDRESPONSE |
assertions¶
A list of assertion statements for session-level evaluation. Each assertion describes an expected behavior or outcome the agent should demonstrate during the session.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_ASSERTIONS() |
Getter for ASSERTIONS, with configurable default |
ASK_ASSERTIONS() |
Getter for ASSERTIONS w/ exceptions if field has no value |
HAS_ASSERTIONS() |
Determine if ASSERTIONS has a value |
expectedTrajectory¶
The expected tool call sequence for session-level trajectory evaluation. Contains a list of tool names representing the tools the agent is expected to invoke.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_EXPECTEDTRAJECTORY() |
Getter for EXPECTEDTRAJECTORY |
Public Local Types In This Class¶
Internal table types, representing arrays and maps of this class, are defined as local types:
TT_EVALUATIONREFERENCEINPUTS¶
TYPES TT_EVALUATIONREFERENCEINPUTS TYPE STANDARD TABLE OF REF TO /AWS1/CL_BDCEVALREFERENCEINPUT WITH DEFAULT KEY
.