Annotation tasks
Run evaluators on items
Run evaluators on task items as a background job
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Run evaluators on task items as a background job
from calibrate import Calibrate, EvaluatorRunRequestEntry
client = Calibrate(
api_key="your_api_key",
)
client.annotation_tasks.create_evaluator_run(
task_uuid="f47ac10b-58cc-4372-a567-0e02b2c3d479",
evaluators=[
EvaluatorRunRequestEntry(
evaluator_id="f47ac10b-58cc-4372-a567-0e02b2c3d479",
)
],
)