Skip to content

Products

The kits

Four libraries for the work product code already does with models. Each one is a small interface with a precise failure mode.

  1. 01

    Model

    The client for generation. Streaming, structured output, and one shape for usage, latency, and errors, across the providers an application already runs.

  2. 02

    Agent

    Tools, handoffs, and runs that can be paused, inspected, and cancelled. State is a value. The trace comes back with the result.

  3. 03

    Eval

    Fixtures and graders that live in the repository. Score a change before it ships, and keep the record next to the diff.

  4. 04

    Retrieval

    Ingestion and query for knowledge the application already holds. What a model is allowed to see is part of the call, not a side effect.

These are libraries. They run in the application process. Production traffic does not have to pass through SDK.