Execute Evaluation

Run evaluation tests on agents or teams. Supports accuracy, performance, and reliability evaluations. Requires either agent_id or team_id, but not both.

Authorizations

Authorization · string · header · required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Query Parameters

db_id · string | null

Database ID to use for evaluation

table · string | null

Table to use for evaluation

Body

application/json

eval_type · enum<string> · required

Type of evaluation to run (accuracy, performance, or reliability)

Available options:

accuracy,

performance,

reliability

input · string · required

Input text/query for the evaluation

Minimum length: 1

agent_id · string | null

Agent ID to evaluate

team_id · string | null

Team ID to evaluate

model_id · string | null

Model ID to use for evaluation

model_provider · string | null

Model provider name

additional_guidelines · string | null

Additional guidelines for the evaluation

additional_context · string | null

Additional context for the evaluation

num_iterations · integer · default: 1

Number of times to run the evaluation

Required range: 1 <= x <= 100

name · string | null

Name for this evaluation run

expected_output · string | null

Expected output for accuracy evaluation

warmup_runs · integer · default: 0

Number of warmup runs before measuring performance

Required range: 0 <= x <= 10

expected_tool_calls · string[] | null

Expected tool calls for reliability evaluation

Response

200

application/json

Evaluation executed successfully

id · string · required

Unique identifier for the evaluation run

eval_type · enum<string> · required

Type of evaluation (accuracy, performance, or reliability)

Available options:

accuracy,

performance,

reliability

eval_data · object · required

Evaluation results and metrics

agent_id · string | null

Agent ID that was evaluated

model_id · string | null

Model ID used in evaluation

model_provider · string | null

Model provider name

team_id · string | null

Team ID that was evaluated

workflow_id · string | null

Workflow ID that was evaluated

name · string | null

Name of the evaluation run

evaluated_component_name · string | null

Name of the evaluated component

eval_input · object | null

Input parameters used for the evaluation

created_at · string<date-time> | null

Timestamp when evaluation was created

updated_at · string<date-time> | null

Timestamp when evaluation was last updated