Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.

Skip to main content

Calibrate home page

Join WhatsApp
GitHub
Get Started
Get Started

Calibrate Local

GitHub
WhatsApp
Changelog

Getting started

Overview

Agent tests

Link tests to agent
Run agent benchmark
Run agent tests
List test runs for agent
List tests for agent
Get benchmark status
Bulk unlink tests from agent
Run agent tests in batch
Get test run status
Get test case result

Agents

List agents
Create agent
Resolve agent names to IDs
Get agent
Update agent
List agent evaluators
Link evaluators to agent
Verify agent connection

Annotation tasks

List annotation tasks
Create annotation task
Get annotation task
Get task agreement
Run evaluators on items
Get evaluator run
Update task evaluators
Bulk create items
Bulk update items
Create labelling jobs
Get task summary

Annotators

List annotators
Create annotator
Update annotator

Datasets

Create dataset
Get dataset
Upload STT dataset item

Evaluators

List evaluators
Create evaluator
Get evaluator
Create evaluator version

Organizations

Get the current workspace

Tests

List tests
Create test
Bulk create tests
Get test
Update test

Traces

List traces
Create trace

Back to top

Usage
API endpoint

Traces

List traces

List ingested traces, newest first

Usage

from calibrate import Calibrate

client = Calibrate(
    api_key="your_api_key",
)

client.traces.list()

API endpoint

See GET /traces in the API reference tab.

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform