Llama API | Eval › Jobs › Retrieve

Eval

eval

Methods

Evaluate Rows ->

EvaluateResponse

post/alpha/eval/evaluate-rows

Run Eval ->

post/alpha/eval/run-eval

Domain types

EvaluateResponse = { generations, scores }

Job = { job_id }

Jobs

eval.jobs

Methods

Cancel ->

post/alpha/eval/job/cancel

Retrieve ->

EvaluateResponse

get/alpha/eval/job/result

Parameters

job_id: string

task_id: string

X-LlamaStack-Client-Version: string

Optional

X-LlamaStack-Provider-Data: string

Optional

Response fields

EvaluateResponse

Request example

curl http://any-hosted-llama-stack.com/alpha/eval/job/result \
    -d '{}'

200Example

{
  "generations": [
    {
      "foo": true
    }
  ],
  "scores": {
    "foo": {
      "aggregated_results": {
        "foo": true
      },
      "score_rows": [
        {
          "foo": true
        }
      ]
    }
  }
}

Status -> "completed" | "in_progress" | "failed" | 1 more...

get/alpha/eval/job/status