cbl and get it configured with the necessary API keys.
Prerequisites
Before installing, you’ll need:- Circuit Breaker Labs API Key - Required to run evaluations
- Model Provider API Key - Depending on which provider you use:
- OpenAI API key for OpenAI models
- Ollama installed locally for Ollama models
- Custom endpoint credentials for custom providers
Installation Methods
Pre-built Binaries (Recommended)
Pre-built executables for Linux, macOS, and Windows are available with each release. Visit the releases page to download the latest version.Download the Binary
Go to the Circuit Breaker Labs CLI releases page and download the appropriate binary for your platform:
- Linux:
cbl-linux-x86_64.tar.gz - macOS (Intel):
cbl-macos-x86_64.tar.gz - macOS (Apple Silicon):
cbl-macos-aarch64.tar.gz - Windows:
cbl-windows-x86_64.zip
Shell-Specific Installation (Linux/macOS)
The releases page also provides shell-specific installation commands for quick setup:The installation scripts automatically detect your platform and download the correct binary.
Configuration
Setting Up API Keys
Circuit Breaker Labs CLI requires environment variables for authentication. Set these in your shell profile:Circuit Breaker Labs API Key
Export your Circuit Breaker Labs API key:
You can also pass this as a command-line argument:
--cbl-api-key YOUR_KEYOptional Configuration
You can customize the Circuit Breaker Labs API endpoint if needed:Most users don’t need to set
CBL_API_BASE_URL - the default value works for standard installations.Verification
Verify your installation and configuration:View Available Commands
- Available evaluation types:
single-turn,multi-turn - Global options:
--cbl-api-key,--output-file,--log-mode - Usage examples
Platform-Specific Notes
Linux
- Ensure the binary has execute permissions:
chmod +x cbl - Add to PATH by placing in
/usr/local/binor~/.local/bin - Tested on Ubuntu 20.04+, Debian 11+, Fedora 35+, and Arch Linux
macOS
- Apple Silicon (M1/M2/M3): Use the
aarch64binary - Intel Macs: Use the
x86_64binary - You may need to allow the binary in System Preferences → Security & Privacy if you see a security warning
- Alternatively, remove the quarantine attribute:
xattr -d com.apple.quarantine /usr/local/bin/cbl
Windows
- Extract the ZIP file to a permanent location (e.g.,
C:\Program Files\cbl\) - Add the directory to your PATH environment variable
- Run from PowerShell, Command Prompt, or Windows Terminal
- Git Bash and WSL are also supported
Troubleshooting
Command not found: cbl
Command not found: cbl
The
cbl binary is not in your PATH. Either:- Move it to a directory in your PATH:
sudo mv cbl /usr/local/bin/ - Add the directory containing
cblto your PATH - Run it with the full path:
/path/to/cbl
Permission denied when running cbl
Permission denied when running cbl
The binary doesn’t have execute permissions. Fix with:
CBL_API_KEY environment variable not set
CBL_API_KEY environment variable not set
You need to export your Circuit Breaker Labs API key:Or pass it as a flag:
cbl --cbl-api-key YOUR_KEY ...macOS security warning: 'cbl cannot be opened'
macOS security warning: 'cbl cannot be opened'
macOS Gatekeeper is blocking the binary. Options:
- Go to System Preferences → Security & Privacy and click “Open Anyway”
- Remove the quarantine attribute:
xattr -d com.apple.quarantine /usr/local/bin/cbl
OPENAI_API_KEY not set when using OpenAI provider
OPENAI_API_KEY not set when using OpenAI provider
Export your OpenAI API key:Or pass it directly:
cbl single-turn openai --api-key sk-... --model gpt-4Getting API Access
To get your Circuit Breaker Labs API key:Request API Access
Click here to email the Circuit Breaker Labs team and request API access. Include information about your use case and the models you plan to evaluate.
Next Steps
Now that you havecbl installed and configured:
Quickstart Guide
Run your first evaluation in minutes
View on GitHub
Explore the source code and examples
Need help? Contact [email protected]