curl --request POST \
--url https://api.calibrate.artpark.ai/evaluators/{evaluator_uuid}/versions \
--header 'Content-Type: application/json' \
--header 'X-API-Key: <api-key>' \
--data '
{
"judge_model": "<string>",
"system_prompt": "<string>"
}
'import requests
url = "https://api.calibrate.artpark.ai/evaluators/{evaluator_uuid}/versions"
payload = {
"judge_model": "<string>",
"system_prompt": "<string>"
}
headers = {
"X-API-Key": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text){
"version_uuid": "6ba7b810-9dad-11d1-80b4-00c04fd430c8",
"version_number": 123
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Create evaluator version
Add a new version to an evaluator you created
curl --request POST \
--url https://api.calibrate.artpark.ai/evaluators/{evaluator_uuid}/versions \
--header 'Content-Type: application/json' \
--header 'X-API-Key: <api-key>' \
--data '
{
"judge_model": "<string>",
"system_prompt": "<string>"
}
'import requests
url = "https://api.calibrate.artpark.ai/evaluators/{evaluator_uuid}/versions"
payload = {
"judge_model": "<string>",
"system_prompt": "<string>"
}
headers = {
"X-API-Key": "<api-key>",
"Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text){
"version_uuid": "6ba7b810-9dad-11d1-80b4-00c04fd430c8",
"version_number": 123
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Authorizations
API key for authentication
Path Parameters
Evaluator to add a version to
"f47ac10b-58cc-4372-a567-0e02b2c3d479"
Body
Request body for adding a version to an existing evaluator.
The model that runs the judge, named the way its provider does, for example openai/gpt-4.1 or anthropic/claude-sonnet-4
Judge system prompt. May contain {{variable}} placeholders
The scale points and their labels. Required for a rating evaluator. A binary evaluator uses the default Correct/Wrong labels unless you set your own
Show child attributes
Show child attributes
Declared prompt variables. Omit if the prompt has none. After the first version the variable names are fixed. You can change a variable's description or default, but not add, remove, or rename one
Show child attributes
Show child attributes
When true, immediately point the evaluator's live version at this new version