Back to Documentation

Notifications & Alerts

AutoSmoke can notify you whenever your scheduled tests complete. You can set up multiple alerts per project, each with its own delivery channel and trigger conditions.

Alert Types

Email

Send test results to any email address via Resend. Each email includes a summary of total, passed, and failed tests with a link to view full results.

Setup: Enter the recipient email address — no additional configuration needed.

Slack

Post test results to a Slack channel using an incoming webhook. Messages include a color-coded attachment (green for all passing, red for failures), test stats, and a button linking to the results page.

Setup:

  1. In Slack, go to Apps > Incoming Webhooks (or create a new Slack app)
  2. Add a new webhook to your desired channel
  3. Copy the webhook URL (starts with https://hooks.slack.com/services/...)
  4. Paste it into the Webhook URL field when creating the alert

Webhook

Send test results as a JSON payload to any HTTPS endpoint. This is useful for integrating with custom dashboards, incident management tools, or automation pipelines.

Setup: Enter any HTTPS URL. AutoSmoke will POST a JSON payload to this URL whenever alert conditions are met.

Payload format:

{
  "event": "tests_completed",
  "timestamp": "2026-03-30T12:00:00.000Z",
  "project": {
    "domain": "example.com",
    "url": "https://autosmoke.dev/dashboard/sites/abc123"
  },
  "results": {
    "status": "failed",
    "total": 5,
    "passed": 3,
    "failed": 2
  }
}

| Field | Description | | --- | --- | | event | Always "tests_completed" | | timestamp | ISO 8601 timestamp of when the notification was sent | | project.domain | The domain being tested | | project.url | Link to the project dashboard | | results.status | "passed" if all tests passed, "failed" if any failed | | results.total | Total number of tests in the batch | | results.passed | Number of passing tests | | results.failed | Number of failing tests |

Your endpoint should return a 2xx status code. Non-2xx responses are treated as delivery failures.

Trigger Conditions

Each alert supports three trigger conditions that control when notifications are sent:

| Condition | Fires when | | --- | --- | | On failure | One or more tests in the batch failed | | On recovery | All tests passed, but the previous batch had failures | | Every run | Every time a batch of tests completes, regardless of outcome |

You can enable any combination of these. For example, enabling both "On failure" and "On recovery" notifies you when things break and when they're fixed, but stays quiet during normal passing runs.

Creating an Alert

From the Alerts page

  1. Go to Dashboard > Alerts
  2. Click New Alert
  3. Select the site, choose the alert type (Email, Slack, or Webhook)
  4. Enter the destination (email address, Slack webhook URL, or webhook URL)
  5. Choose your trigger conditions
  6. Click Save Alert

From a site detail page

  1. Open any site in the dashboard
  2. Expand the Alerts section
  3. Click Add Alert
  4. Fill in the same fields as above

Managing Alerts

  • Enable/disable an alert with the toggle switch — disabled alerts are not sent
  • Delete an alert with the delete button — this is permanent

Next Steps