Create annotation task
curl --request POST \
--url https://api.calibrate.artpark.ai/annotation-tasks \
--header 'Content-Type: application/json' \
--header 'X-API-Key: <api-key>' \
--data '
{
"name": "<string>"
}
'import requests
url = "https://api.calibrate.artpark.ai/annotation-tasks"
payload = { "name": "<string>" }
headers = {
"X-API-Key": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text){
"uuid": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"message": "<string>"
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Annotation tasks
Create annotation task
Create an annotation task for annotators to label items against evaluators
POST
/
annotation-tasks
Create annotation task
curl --request POST \
--url https://api.calibrate.artpark.ai/annotation-tasks \
--header 'Content-Type: application/json' \
--header 'X-API-Key: <api-key>' \
--data '
{
"name": "<string>"
}
'import requests
url = "https://api.calibrate.artpark.ai/annotation-tasks"
payload = { "name": "<string>" }
headers = {
"X-API-Key": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text){
"uuid": "f47ac10b-58cc-4372-a567-0e02b2c3d479",
"message": "<string>"
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Authorizations
API key for authentication
Body
application/json
Task name, unique within your workspace
Task type. Determines the shape of each item's payload.
stt: judge a transcript on its ownllm: judge one response with its conversation historyllm-general: judge a standaloneinput -> outputpairconversation: judge a full conversation
Available options:
stt, llm, llm-general, conversation, tts A description for the task. Omit for none
IDs of evaluators to link when the task is created, in order. Each must be one you created or a built-in default. Omit to create with no linked evaluators
Example:
["f47ac10b-58cc-4372-a567-0e02b2c3d479"]