Skip to main content
A simulation is a set of practice conversations with your agent. An AI plays the student. It talks to your agent from start to finish, and Calibrate scores each conversation. For example, an AI can play Riya, a class 6 student stuck on fractions, and ask the Maths homework tutor for help with her homework. You then see whether the tutor explained the next step or simply gave the answer.

What a simulation is made of

You set up three things before you run a simulation. Each one has its own page in the sidebar, under Agent simulations. When you run a simulation, Calibrate has one conversation for every persona and scenario pair. Two personas and two scenarios give four conversations.

Text or voice

You choose the kind of run each time you click Launch:
  • Text Simulation: the student and the agent type to each other. This is the faster run.
  • Voice Simulation: the student and the agent speak to each other. You can listen to each conversation and see how long each part of your agent took to reply.
Voice simulations work only for agents built in Calibrate. An agent you connect from your own server can run text simulations, unless it uses custom fields. Text simulations do not work for connections with custom fields.

Next steps

Personas

Describe who the student is

Scenarios

Describe what the student wants

Simulation evaluators

Choose how each conversation is scored

Run a simulation

Run a text or voice simulation and read the results