StatusPage Webhook

Webhook-based automation for StatusPage Component status.

Purpose

There is no easy, out of the box way to automate moving a StatusPage Component between DOWN and UP based on a DataDog Monitor alerting and resolving.

StatusPage components are (only) automated by sending an email to a magic address with "UP" or "DOWN" in the subject line.

DataDog Monitors cannot notify by sending emails:

• In my testing, the documented sending of an email to an arbitrary address does not work; you can only send emails to (verified) team members' emails
• Even if that worked, the subject of the email is hard-coded as the title of the Monitor
• Even if the title/subject were editable, the conditional "UP" or "DOWN" content could not be added since {{is_alert}} template variables don't work there

However, DataDog has a very flexible Webhooks integration. Therefore, some glue code which accepts a Webhook and sends an email is our current solution to this problem.

Getting Started

yarn

If you're a Freckler...

• Join our organization on Serverless
• Run ./node_modules/.bin/serverless login
• Log into AWS via Okta and always have $AWS_PROFILE set

If you're not a Freckler...

• Remove the org and app from serverless.yaml
• Ensure AWS is properly configured
• Change FROM_ADDRESS in the code and verify it in SES

Testing

To run unit tests:

yarn test

To deploy the dev stage and test it using a mock UP event:

% yarn run deploy
% yarn run invoke.up
{
    "statusCode": 200,
    "headers": {},
    "body": "Updated component+82804938-8678-43c8-92ac-92ac28940d07@notifications.statuspage.io to UP.\n"
}

Release

• Update version in package.json

• Deploy the prod stage

  yarn run deploy.prod

• Tag in Git

  git tag -s -m vX.Y.Z vX.Y.Z

Usage

Perform a POST to your deployed endpoint with the following body:

{
  "message": "...",
  "tags": "...,statuspage-component-email:{...},..."
}

Where message contains the string UP or DOWN anywhere and tags contains the Automation email address for the desired StatusPage Component at the key shown.

DataDog Integration

1. Tag your Monitor with a Component Automation address

   statuspage-component-email:component+{...}@notifications.statuspage.io
   

2. Add a Webhooks Integration

   • URL: your Serverless application's endpoint

   • Payload:

     {
       "message": "$EVENT_MSG",
       "tags": "$TAGS"
     }

3. Update your Monitor to notify the Webhook integration with UP or DOWN

   @webhook-xyz
   
   {{#is_alert}}DOWN{{/is_alert}}
   {{#is_recovery}}UP{{/is_recovery}}
   

---

LICENSE | CHANGELOG