Evaluators
Create evaluator
Create an evaluator along with its first version, which is set live
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Create an evaluator along with its first version, which is set live
from calibrate import Calibrate, EvaluatorVersionCreate
client = Calibrate(
api_key="your_api_key",
)
client.evaluators.create(
name="name",
version=EvaluatorVersionCreate(
judge_model="judge_model",
system_prompt="system_prompt",
),
)