Run all evaluators attached to a dataset on every item

POST /v1/datasets-v2/{datasetId}/evaluators/run

Run all evaluators attached to a dataset on every item

cURL

curl --request POST \
  --url https://api.lunary.ai/v1/datasets-v2/{datasetId}/evaluators/run \
  --header 'Authorization: Bearer <token>'

200

{
  "updatedItemCount": 123,
  "dataset": {
    "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "projectId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "ownerId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "ownerName": "<string>",
    "ownerEmail": "<string>",
    "name": "<string>",
    "description": "<string>",
    "createdAt": "2023-11-07T05:31:56Z",
    "updatedAt": "2023-11-07T05:31:56Z",
    "itemCount": 123,
    "currentVersionId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "currentVersionNumber": 123,
    "currentVersionCreatedAt": "2023-11-07T05:31:56Z",
    "currentVersionCreatedBy": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "currentVersionRestoredFromVersionId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot1Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot2Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot3Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot4Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "evaluatorSlot5Id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
    "items": [
      {
        "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
        "datasetId": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
        "input": "<string>",
        "groundTruth": "<string>",
        "output": "<string>",
        "evaluatorResult1": {},
        "evaluatorResult2": {},
        "evaluatorResult3": {},
        "evaluatorResult4": {},
        "evaluatorResult5": {},
        "createdAt": "2023-11-07T05:31:56Z",
        "updatedAt": "2023-11-07T05:31:56Z"
      }
    ]
  }
}

Authorizations

Authorization · string · header · required

Use a project private API key via Authorization: Bearer <key>.

Path Parameters

datasetId · string<uuid> · required

Response

200 - application/json

Evaluator results updated

updatedItemCount · integer

dataset · object

Show child attributes