AutoSmoke can notify you whenever your scheduled tests complete. You can set up multiple alerts per project, each with its own delivery channel and trigger conditions.
Alert Types#
Email#
Send test results to any email address via Resend. Each email includes a summary of total, passed, and failed tests with a link to view full results.
Setup: Enter the recipient email address — no additional configuration needed.
Slack#
Post test results to a Slack channel using an incoming webhook. Messages include a color-coded attachment (green for all passing, red for failures), test stats, and a button linking to the results page.
Setup:
- In Slack, go to Apps > Incoming Webhooks (or create a new Slack app)
- Add a new webhook to your desired channel
- Copy the webhook URL (starts with
https://hooks.slack.com/services/...) - Paste it into the Webhook URL field when creating the alert
Webhook#
Send test results as a JSON payload to any HTTPS endpoint. This is useful for integrating with custom dashboards, incident management tools, or automation pipelines.
Setup: Enter any HTTPS URL. AutoSmoke will POST a JSON payload to this URL whenever alert conditions are met.
Payload format:
{
"event": "tests_completed",
"timestamp": "2026-03-30T12:00:00.000Z",
"project": {
"domain": "example.com",
"url": "https://autosmoke.dev/dashboard/sites/abc123"
},
"results": {
"status": "failed",
"total": 5,
"passed": 3,
"failed": 2
}
}
| Field | Description |
|---|---|
event | Always "tests_completed" |
timestamp | ISO 8601 timestamp of when the notification was sent |
project.domain | The domain being tested |
project.url | Link to the project dashboard |
results.status | "passed" if all tests passed, "failed" if any failed |
results.total | Total number of tests in the batch |
results.passed | Number of passing tests |
results.failed | Number of failing tests |
Your endpoint should return a 2xx status code. Non-2xx responses are treated as delivery failures.
Trigger Conditions#
Each alert supports three trigger conditions that control when notifications are sent:
| Condition | Fires when |
|---|---|
| On failure | One or more tests in the batch failed |
| On recovery | All tests passed, but the previous batch had failures |
| Every run | Every time a batch of tests completes, regardless of outcome |
You can enable any combination of these. For example, enabling both "On failure" and "On recovery" notifies you when things break and when they're fixed, but stays quiet during normal passing runs.
Creating an Alert#
From the Alerts page#
- Go to Dashboard > Alerts
- Click New Alert
- Select the site, choose the alert type (Email, Slack, or Webhook)
- Enter the destination (email address, Slack webhook URL, or webhook URL)
- Choose your trigger conditions
- Click Save Alert
From a site detail page#
- Open any site in the dashboard
- Expand the Alerts section
- Click Add Alert
- Fill in the same fields as above
Managing Alerts#
- Enable/disable an alert with the toggle switch — disabled alerts are not sent
- Delete an alert with the delete button — this is permanent
Next Steps#
- Getting Started — Set up your first test
- CI/CD Integration — Run tests automatically on every PR
- Troubleshooting — Common issues and fixes