Execute agent-goal-accuracy evaluator

Evaluate agent goal accuracy

Request Body:

• input.question (string, required): The original question or goal
• input.completion (string, required): The agent’s completion/response
• input.reference (string, required): The expected reference answer

POST /v2/evaluators/execute/agent-goal-accuracy

Execute agent-goal-accuracy evaluator

cURL

curl --request POST \
  --url https://api.traceloop.com/v2/evaluators/execute/agent-goal-accuracy \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "input": {
    "completion": "I have booked your flight from New York to Los Angeles departing Monday at 9am.",
    "question": "Book a flight from NYC to LA for next Monday",
    "reference": "Flight booked: NYC to LA, Monday departure"
  }
}
'

200

{
  "accuracy_score": 0.88
}

Authorizations

Authorization · string · header · required

Type "Bearer" followed by a space and JWT token.

Body

application/json

Request body

input · object · required

Show child attributes

Response

200

application/json

OK

accuracy_score · number

Example:

0.88