Braintrust Integration
Braintrust is an AI evaluation and observability platform that helps teams build reliable AI products.
Overview
The Braintrust integration enables LangGuard to:
- Import traces from Braintrust projects
- Sync evaluations and experiment results
- Track prompts and model outputs
- Apply governance policies to AI operations
Prerequisites
- A Braintrust account
- API key from Braintrust
- Active project with logged traces
Getting Your API Key
- Log in to Braintrust
- Navigate to Settings
- Find API Keys section
- Create or copy your API key
Setup
Add Integration
- Navigate to Settings > Integrations in LangGuard
- Click Add Integration
- Select Braintrust
- Enter credentials:
- Name: Friendly name
- API Key: Your Braintrust API key
- Click Test Connection
- Configure sync settings
- Click Save
Environment Variables
BRAINTRUST_API_KEY=your-api-key
What Gets Synced
| Braintrust Entity | LangGuard Mapping |
|---|---|
| Spans | Traces |
| Experiments | Grouped by project |
| Evaluations | Metadata |
| Scores | Quality metrics |
Troubleshooting
Invalid API Key
- Verify key is correct
- Check key hasn't expired
- Generate a new key if needed
No Data Syncing
- Verify traces exist in Braintrust
- Check project permissions
- Adjust time range settings
Next Steps
- Trace Explorer - Analyze synced traces
- Policies - Apply governance rules