Run evaluators on items
curl --request POST \
--url https://api.calibrate.artpark.ai/annotation-tasks/{task_uuid}/evaluator-runs \
--header 'Content-Type: application/json' \
--header 'X-API-Key: <api-key>' \
--data '
{
"evaluators": [
{
"evaluator_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"evaluator_version_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479"
}
]
}
'import requests
url = "https://api.calibrate.artpark.ai/annotation-tasks/{task_uuid}/evaluator-runs"
payload = { "evaluators": [
{
"evaluator_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"evaluator_version_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479"
}
] }
headers = {
"X-API-Key": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text){
"job_uuid": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"status": "queued",
"evaluator_count": 123,
"item_count": 123
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Annotation tasks
Run evaluators on items
Run evaluators on task items as a background job
POST
/
annotation-tasks
/
{task_uuid}
/
evaluator-runs
Run evaluators on items
curl --request POST \
--url https://api.calibrate.artpark.ai/annotation-tasks/{task_uuid}/evaluator-runs \
--header 'Content-Type: application/json' \
--header 'X-API-Key: <api-key>' \
--data '
{
"evaluators": [
{
"evaluator_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"evaluator_version_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479"
}
]
}
'import requests
url = "https://api.calibrate.artpark.ai/annotation-tasks/{task_uuid}/evaluator-runs"
payload = { "evaluators": [
{
"evaluator_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"evaluator_version_id": "f47ac10b-58cc-4372-a567-0e02b2c3d479"
}
] }
headers = {
"X-API-Key": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text){
"job_uuid": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"status": "queued",
"evaluator_count": 123,
"item_count": 123
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Authorizations
API key for authentication
Path Parameters
Annotation task to act on
Example:
"f47ac10b-58cc-4372-a567-0e02b2c3d479"
Body
application/json
The evaluators to run. Each must be linked to the task
Show child attributes
Show child attributes
Item IDs to run on. Required when select_all=false. Ignored when select_all=true
When true, run on every item in the task. Set q to run only items whose name matches it
Case-insensitive substring filter on payload.name. Applies only when select_all=true
Response
Successful Response
ID of the evaluator-run job. Poll it for status and results
Example:
"f47ac10b-58cc-4372-a567-0e02b2c3d479"
Status of the job right after you launch it
Available options:
queued, in_progress How many evaluators the job will run
How many items the job will run on