Annotation tasks
Get task agreement
Get human-vs-human and human-vs-evaluator agreement metrics for a task
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Get human-vs-human and human-vs-evaluator agreement metrics for a task
from calibrate import Calibrate
client = Calibrate(
api_key="your_api_key",
)
client.annotation_tasks.get_agreement(
task_uuid="f47ac10b-58cc-4372-a567-0e02b2c3d479",
)