Architecture

Braintrust allows you to log raw data while you run your AI applications, including inputs, outputs, and prompts. Because of the sensitivity of this data, we support running the logging stack in your AWS account, ensuring that data never leaves your account, and never flows through Braintrust's infrastructure. This component is referred to as the data plane.

At its core, the data plane deployment works by installing an API layer along with a database in your environment. On AWS, this is packaged as a few AWS Lambda function, a Postgres database, and a few other services in a VPC, packaged up as a CloudFormation template. You can also deploy it via docker just about anywhere.

When you log from Braintrust's Typescript or Python library, it sends the events directly to the data plane, never touching Braintrust's servers. And when you visit the UI (on https://www.braintrustdata.com/app), your browser runs requests against the data plane directly.