Overview
PIPELINE supports webhook integrations to notify external services when events occur in your job tracking workflow. Currently, Discord webhooks are fully implemented with additional webhook types planned for v1.Webhooks enable real-time notifications to Discord channels, Slack workspaces, and other services that support incoming webhooks.
Discord Webhooks
Event Types
The following Discord webhook events are currently available:job_created
job_created
Triggered when a new job is saved to your pipeline.Payload Data:
status_changed
status_changed
Triggered when a job’s status changes.Payload Data:
scraper_completed
scraper_completed
Triggered when a scraper finishes running.Payload Data:
daily_digest
daily_digest
Triggered once per day with a summary of activity.Payload Data:
error_alert
error_alert
Triggered when critical errors occur.Payload Data:
Configuration
Set up Discord webhooks using environment variables:.env
Webhook Features
Retry Logic
Automatic retry with exponential backoff (up to 3 attempts)
Circuit Breaker
Temporarily disables webhooks after repeated failures
Rate Limiting
Respects Discord’s rate limits automatically
Rich Embeds
Color-coded embeds with formatted data
Error Handling
Webhook errors are handled gracefully:| Error Code | Description | Retry |
|---|---|---|
SEND_FAILED | Generic send failure | Yes |
RATE_LIMITED | Discord rate limit hit | Yes (with delay) |
CIRCUIT_OPEN | Circuit breaker activated | No |
INVALID_WEBHOOK | Webhook URL invalid | No |
TIMEOUT | Request timed out | Yes |
Planned Webhooks (v1)
The following webhook integrations are planned for the v1 release:Best Practices
Security
Security
- Store webhook URLs in environment variables
- Use separate webhooks for different environments
- Rotate webhook URLs periodically
- Never commit webhook URLs to version control
Performance
Performance
- Webhooks are sent asynchronously to avoid blocking API requests
- Failed webhooks don’t prevent the main operation from completing
- Circuit breaker prevents webhook storms
Monitoring
Monitoring
- Check circuit breaker status if webhooks stop working
- Monitor Discord’s rate limit headers
- Set up error alerts for webhook failures
Example: Discord Webhook Payload
Related Documentation
Rate Limits
Learn about API rate limiting
Error Codes
View all error codes and handling