curl --request POST \
--url https://api.traceloop.com/v2/evaluators/execute/agent-goal-accuracy \
--header 'Authorization: <api-key>' \
--header 'Content-Type: application/json' \
--data '
{
"input": {
"completion": "I have booked your flight from New York to Los Angeles departing Monday at 9am.",
"question": "Book a flight from NYC to LA for next Monday",
"reference": "Flight booked: NYC to LA, Monday departure"
}
}
'
{
"accuracy_score": 0.88
}
Evaluators
Execute agent-goal-accuracy evaluator
Evaluate agent goal accuracy
Request Body:
input.question (string, required): The original question or goal
input.completion (string, required): The agent’s completion/response
input.reference (string, required): The expected reference answer
POST
/
v2
/
evaluators
/
execute
/
agent-goal-accuracy
Execute agent-goal-accuracy evaluator
curl --request POST \
--url https://api.traceloop.com/v2/evaluators/execute/agent-goal-accuracy \
--header 'Authorization: <api-key>' \
--header 'Content-Type: application/json' \
--data '
{
"input": {
"completion": "I have booked your flight from New York to Los Angeles departing Monday at 9am.",
"question": "Book a flight from NYC to LA for next Monday",
"reference": "Flight booked: NYC to LA, Monday departure"
}
}
'