Introduction to Braintrust

Purpose

Braintrust provides visibility into the performance of AI-driven features. It serves three main goals:

• CI/CD: Experiments allow you to test changes to AI features before shipping them
• Observability: Logs ensure production code successfully delivers AI features
• IDE: Playgrounds allow you to quickly iterate by exploring changes to prompts and other parameters

How it Works

To Experiment

1. Instrument your code using Eval(), traced(), experiment.traced(), or experiment.log()
2. Run the code to see results in Braintrust’s Experiments page

To Log

1. Instrument your code using traced() or logger.traced()
2. Run the code to see results in Braintrust’s Logs page