Skip to main content
POST
/
api
/
v1
/
evaluations
/
{evaluation_id}
/
samples
Push Samples
curl --request POST \
  --url https://api.primeintellect.ai/api/v1/evaluations/{evaluation_id}/samples \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "samples": [
    {
      "example_id": 123,
      "reward": 123,
      "task": "<string>",
      "answer": "<string>",
      "prompt": [
        {
          "role": "<string>",
          "content": "<string>",
          "tool_calls": [
            "<any>"
          ],
          "tool_call_id": "<string>"
        }
      ],
      "completion": [
        {
          "role": "<string>",
          "content": "<string>",
          "tool_calls": [
            "<any>"
          ],
          "tool_call_id": "<string>"
        }
      ],
      "score": 123,
      "correct": true,
      "num_steps": 123,
      "total_time": 123,
      "latency_ms": 123,
      "rollout_number": 123,
      "metadata": {}
    }
  ]
}'
{
  "evaluation_id": "<string>",
  "samples_pushed": 123,
  "status": "RUNNING"
}

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

evaluation_id
string
required

Body

application/json

Request to push evaluation samples (replaces traces)

samples
EvaluationSample · object[]
required

List of evaluation samples

Response

Successful Response

Response after pushing samples

evaluation_id
string
required
samples_pushed
integer
required
status
enum<string>
required

Evaluation status enum

Available options:
RUNNING,
COMPLETED,
FAILED,
CANCELLED
I