Slack Integration for Runbooks
Harness AI SRE integrates with Slack at the organization level, enabling automated incident communication and team collaboration across all projects.
Overview
Slack integration enables your runbooks to:
- Send automated notifications
- Create incident-specific channels
- Manage threaded discussions
- Coordinate response teams
- Track incident updates
Integration Setup
Prerequisites
- Slack Workspace Admin access
- Harness Organization Admin role
Setup Steps
- Navigate to Organization Settings → Third Party Integrations (AI SRE)
- Click Connect for Slack
- Follow the OAuth flow to authorize Harness
- Configure workspace permissions
Required Slack Permissions
The Harness Slack bot requires these permissions:
channels:manage- Create and manage channelschat:write- Send messagesgroups:write- Manage private channelsim:write- Send direct messages
Features
- Global Slack workspace access across all projects
- Unified authentication
- Centralized channel management
- Cross-project notifications
Using Slack Actions in Runbooks
When you add Slack actions to a runbook, you'll configure them through a form-based interface. The specific fields depend on the action type you select.
Send Slack Message Action
Sends a message to a specified Slack channel.
Form Fields:
- Channel: Channel name or ID (e.g.,
#incidentsor{{Activity.slack_channel}}) - Message: Message text to send
- Supports Mustache variables:
{{Activity.title}},{{Activity.summary}} - Can include Slack markdown formatting (bold, italics, links)
- Supports Block Kit JSON format for rich message layouts (see Advanced Formatting below)
- Supports Mustache variables:
Create Slack Channel Action
Creates a new Slack channel for incident coordination.
Form Fields:
- Channel Name: Name for the new channel (must follow Slack naming rules)
- Example:
incident-{{Activity.id}}
- Example:
- Description: Channel topic/description
- Is Private: Whether to create a private channel
Available Mustache Variables:
{{Activity.title}}- AI SRE incident title{{Activity.id}}- AI SRE incident ID{{Activity.severity}}- AI SRE incident severity{{Activity.severity.id}}- AI SRE incident severity ID (e.g., 1, 2, 3){{Activity.status}}- AI SRE incident status{{Activity.summary}}- AI SRE incident summary- Any custom incident fields configured in your incident template
Advanced Message Formatting with Block Kit
Harness AI SRE supports Slack's Block Kit JSON format for rich message layouts. Block Kit allows you to create visually structured messages with different text sizes, colors, and formatting options beyond basic markdown.
When to Use Block Kit
Use Block Kit when you need:
- Visually distinct severity indicators
- Multi-section messages with different formatting
- Compact supplementary information
- Consistent message layouts across incidents
- Rich interactive elements (buttons, menus)
Use simple text when you need:
- Quick notifications without special formatting
- Plain status updates
- Messages with only basic markdown
Block Kit Format Overview
Block Kit messages are defined as JSON arrays containing block objects. Each block has a type that determines its appearance and behavior. The Message field in the Send Slack Message action accepts either plain text or Block Kit JSON.
Section Block (Standard Formatting)
Use Section blocks for standard-sized text with markdown support. This is ideal for primary incident information and announcements.
Example: Incident Alert with Severity
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "<!channel> :rotating_light: *There is a new SEV{{Activity.severity.id}} incident*"
}
}
]
Rendered Output:
- Standard text size
- Full markdown support (bold, italics, links, emoji)
- Black text on white background
- Suitable for primary content
With Multiple Variables:
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "<!channel> :rotating_light: *{{Activity.title}}*\n\n*Severity:* SEV{{Activity.severity.id}}\n*Status:* {{Activity.status}}\n*ID:* {{Activity.id}}"
}
}
]
Context Block (Compact Formatting)
Use Context blocks for smaller, compact gray text. This is ideal for supplementary information, metadata, or instructions that should be visually de-emphasized.
Example: Supplementary Instructions
[
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "<!channel> :rotating_light: *There is a new SEV{{Activity.severity.id}} incident* – Click *View Summary* above for details (will only be visible to you)."
}
]
}
]
Rendered Output:
- Smaller text size
- Gray text color
- Markdown support in each element
- Suitable for secondary information
Key Difference from Section Block:
- Context blocks use an
elementsarray (can contain multiple text elements) - Section blocks use a single
textobject - Context blocks render in a more compact, muted style
Combining Multiple Blocks
Create rich, multi-section messages by combining block types. Blocks are rendered in array order.
Example: Incident Notification with Details and Instructions
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "<!channel> :rotating_light: *New SEV{{Activity.severity.id}} Incident Detected*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Title:* {{Activity.title}}\n*Status:* {{Activity.status}}\n*Summary:* {{Activity.summary}}"
}
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": ":point_right: View full incident details: <https://app.harness.io/incidents/{{Activity.id}}|Incident {{Activity.id}}>"
}
]
}
]
Divider Blocks
Add visual separation between sections using divider blocks.
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Incident Alert*"
}
},
{
"type": "divider"
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "Details go here..."
}
}
]
Markdown Formatting in Block Kit
Within mrkdwn text fields, you can use:
- Bold:
*text* - Italics:
_text_ - Strikethrough:
~text~ - Code:
`code` - Code block:
```code block``` - Links:
<URL|link text> - User mentions:
<@USER_ID> - Channel mentions:
<!channel>,<!here>,<#CHANNEL_ID> - Emoji:
:emoji_name: - Line breaks:
\n
Variable Interpolation in Block Kit
Mustache variables work seamlessly within Block Kit JSON. Variables are replaced before the JSON is sent to Slack.
Examples:
{{Activity.severity.id}}→1,2,3{{Activity.title}}→Database Connection Failure{{Activity.status}}→Investigating,Resolved
Important: Ensure variable values do not contain characters that would break JSON syntax (quotes, newlines). Variables are automatically escaped.
Block Kit Templates for Common Scenarios
High Severity Incident Alert
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "<!channel> :red_circle: *CRITICAL: SEV{{Activity.severity.id}} Incident*\n\n*{{Activity.title}}*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Status:* {{Activity.status}}\n*Impact:* {{Activity.summary}}"
}
},
{
"type": "divider"
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "Incident ID: {{Activity.id}} | <https://app.harness.io/incidents/{{Activity.id}}|View Details>"
}
]
}
]
Status Update Notification
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": ":information_source: *Incident Status Update*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Incident:* {{Activity.title}}\n*New Status:* {{Activity.status}}"
}
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "Updated at {{Activity.updated_at}} | SEV{{Activity.severity.id}}"
}
]
}
]
Resolution Notification
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": ":white_check_mark: *Incident Resolved*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Incident:* {{Activity.title}}\n*Severity:* SEV{{Activity.severity.id}}\n*Duration:* {{Activity.duration}}"
}
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "All systems operational | <https://app.harness.io/incidents/{{Activity.id}}/postmortem|View Post-Mortem>"
}
]
}
]
Block Kit Limitations in AI SRE
When using Block Kit in Harness AI SRE, be aware of these constraints:
- Block limit: Slack allows up to 50 blocks per message
- Text length: Section and context text fields have a 3,000 character limit
- JSON validation: Invalid JSON will cause the action to fail. Validate syntax before deploying.
- Interactive elements: While Slack supports buttons and interactive elements in Block Kit, these are not currently interactive when sent from AI SRE runbooks (they are displayed but do not trigger callbacks).
- Variable escaping: Mustache variables are automatically escaped, but ensure your incident data does not contain malformed JSON characters.
Testing Block Kit Messages
Before deploying runbooks with Block Kit messages:
- Use Slack's Block Kit Builder: Test your JSON at api.slack.com/block-kit to preview the rendered output.
- Test with static data: Replace Mustache variables with example values to validate JSON syntax.
- Run in a test channel: Execute the runbook in a non-production Slack channel first.
- Verify variable rendering: Check that all
{{Activity.*}}variables are replaced correctly in the execution logs.
Migrating from Plain Text to Block Kit
If you have existing runbooks with plain text messages, you can migrate them to Block Kit:
Before (Plain Text):
⚠️ New SEV{{Activity.severity.id}} incident: {{Activity.title}}
Status: {{Activity.status}}
After (Block Kit):
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": ":warning: *New SEV{{Activity.severity.id}} incident: {{Activity.title}}*\n*Status:* {{Activity.status}}"
}
}
]
Benefits:
- Better visual hierarchy
- Consistent formatting
- Easier to add sections without breaking layout
Best Practices
Channel Naming
- Use consistent prefixes:
incident-,alert-,sev1- - Include incident IDs:
incident-{{Activity.id}}-api - Keep names descriptive:
sev{{Activity.severity.id}}-{{Activity.service}} - Follow workspace conventions: lowercase, hyphens, no spaces
- Document naming patterns in runbook descriptions
Message Structure
- Use clear formatting: Structure messages with headers, sections, and spacing
- Include severity indicators: Use emoji (🔴, ⚠️, ℹ️) or text prefixes (SEV1, SEV2)
- Link to relevant resources: Dashboards, runbooks, incident details, monitoring tools
- Mention appropriate teams: Use
<!channel>,<!here>, or<@USER_ID>for targeted notifications - Prioritize readability: Use Block Kit for complex messages, plain text for simple updates
- Keep messages concise: Slack messages should be scannable; avoid large blocks of text
Block Kit Best Practices
- Test before deploying: Always preview Block Kit messages in Slack Block Kit Builder
- Use Section blocks for primary content: Main incident information, alerts, announcements
- Use Context blocks for metadata: Timestamps, IDs, supplementary instructions
- Add dividers for visual separation: Break up long messages into logical sections
- Validate JSON syntax: Use a JSON validator before saving runbook actions
- Limit block count: Keep messages under 20 blocks for best performance
- Store templates: Save common Block Kit patterns as runbook templates for reuse
- Consider accessibility: Ensure emoji and formatting convey meaning even without color
Variable Usage
- Validate variable names: Ensure custom fields exist before using in messages
- Use consistent naming: Match variable names exactly (case-sensitive)
- Provide context: Include labels with variables (
*Severity:* {{Activity.severity.id}}) - Test with sample data: Replace variables with realistic values during testing
- Handle missing data: Consider what happens if a custom field is empty
Permissions
- Use least privilege access: Only grant permissions needed for specific actions
- Regularly audit permissions: Review bot permissions quarterly
- Document access requirements: Maintain list of channels and permissions needed
- Monitor usage patterns: Track message volume and runbook execution frequency
- Rotate credentials: Update OAuth tokens according to security policies
Common Use Cases
Incident Coordination
Workflow:
- Create incident-specific channel
- Notify stakeholders with severity and context
- Share initial assessment and runbook
- Track response actions in threaded conversations
Example Runbook Actions:
Action 1: Create Channel
- Action Type: Create Slack Channel
- Channel Name:
incident-{{Activity.id}}-{{Activity.service}} - Description:
SEV{{Activity.severity.id}} - {{Activity.title}} - Is Private: False
Action 2: Notify Team (Block Kit)
- Action Type: Send Slack Message
- Channel:
#incidents - Message:
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "<!channel> :rotating_light: *SEV{{Activity.severity.id}} Incident Detected*\n\n*{{Activity.title}}*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Service:* {{Activity.service}}\n*Status:* {{Activity.status}}\n*Channel:* <#incident-{{Activity.id}}-{{Activity.service}}>"
}
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "Join <#incident-{{Activity.id}}-{{Activity.service}}> for coordination | <https://app.harness.io/incidents/{{Activity.id}}|View Details>"
}
]
}
]
Status Updates
Workflow:
- Send periodic updates to incident channel
- Track resolution progress with structured messages
- Share metrics, graphs, and monitoring links
- Document action items and next steps
Example Runbook Action:
Action: Status Update (Block Kit)
- Action Type: Send Slack Message
- Channel:
#incident-{{Activity.id}}-{{Activity.service}} - Message:
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": ":information_source: *Status Update*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Current Status:* {{Activity.status}}\n*Progress:* {{Activity.progress_description}}\n*Next Steps:* {{Activity.next_steps}}"
}
},
{
"type": "divider"
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "Updated by {{Activity.updated_by}} at {{Activity.updated_at}}"
}
]
}
]
Post-Incident Communication
Workflow:
- Send resolution notification
- Share incident summary and timeline
- Schedule retrospective meeting
- Archive incident channel
- Document lessons learned
Example Runbook Actions:
Action 1: Resolution Notice (Block Kit)
- Action Type: Send Slack Message
- Channel:
#incident-{{Activity.id}}-{{Activity.service}} - Message:
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": ":white_check_mark: *Incident Resolved*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Incident:* {{Activity.title}}\n*Duration:* {{Activity.duration}}\n*Impact:* {{Activity.impact_summary}}"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Resolution:* {{Activity.resolution_summary}}\n*Root Cause:* {{Activity.root_cause}}"
}
},
{
"type": "divider"
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "<https://app.harness.io/incidents/{{Activity.id}}/postmortem|View Post-Mortem> | Retrospective scheduled for {{Activity.retro_date}}"
}
]
}
]
Action 2: Archive Channel
- Action Type: Archive Slack Channel
- Channel:
incident-{{Activity.id}}-{{Activity.service}}
Scheduled Maintenance Notifications
Example Runbook Action:
Action: Maintenance Alert (Block Kit)
- Action Type: Send Slack Message
- Channel:
#engineering - Message:
[
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": ":construction: *Scheduled Maintenance*"
}
},
{
"type": "section",
"text": {
"type": "mrkdwn",
"text": "*Service:* {{Activity.service}}\n*Start Time:* {{Activity.maintenance_start}}\n*Duration:* {{Activity.maintenance_duration}}\n*Expected Impact:* {{Activity.expected_impact}}"
}
},
{
"type": "context",
"elements": [
{
"type": "mrkdwn",
"text": "Status page: <https://status.example.com|status.example.com> | Questions? Ask in <#sre-team>"
}
]
}
]
Troubleshooting
Message does not appear in Slack channel
Check the following:
- Verify the Slack integration is connected in Organization Settings
- Confirm the channel name or ID is correct
- Ensure the Harness bot has been added to the channel
- Check runbook execution logs for error messages
- Verify the bot has
chat:writepermission
If using a private channel, the bot must be explicitly invited to the channel before it can post messages.
Block Kit JSON message fails to send
Possible causes:
- Invalid JSON syntax (missing brackets, commas, quotes)
- Mustache variable rendering breaks JSON structure
- Block type not supported or misspelled
- Text length exceeds 3,000 character limit
Resolution:
- Validate JSON syntax using jsonlint.com
- Test Block Kit structure in Slack Block Kit Builder
- Replace Mustache variables with sample values to test JSON validity
- Check runbook execution logs for specific JSON parsing errors
- Ensure all text fields use
\nfor line breaks (not actual newlines)
Common JSON errors:
❌ Wrong: "text": "Line 1
Line 2"
✅ Correct: "text": "Line 1\nLine 2"
Mustache variables do not render in Block Kit messages
Possible causes:
- Variable name is misspelled or does not exist
- Custom incident field is not populated
- Variable syntax is incorrect
Resolution:
- Verify the variable name matches exactly (case-sensitive):
{{Activity.severity.id}}not{{activity.severity.id}} - Check that custom incident fields are populated before the runbook executes
- Use correct Mustache syntax:
{{variable}}not{variable}or$variable - Test with standard variables first (
{{Activity.id}},{{Activity.title}}) - Review runbook execution logs to see rendered output
Block Kit message appears but formatting is wrong
Possible causes:
- Using wrong block type for desired layout
- Markdown not enabled (
plain_textinstead ofmrkdwn) - Emoji codes not recognized by Slack
- Link formatting incorrect
Resolution:
- Ensure
"type": "mrkdwn"is set in text objects (not"plain_text") - Test emoji codes in Slack directly (
:rotating_light:,:red_circle:) - Use correct link syntax:
<URL|link text>not[link text](URL) - Preview in Block Kit Builder before deploying
- Check that Section blocks use
textobject, Context blocks useelementsarray
Authentication failures
Possible causes:
- OAuth token expired or revoked
- Slack workspace admin disabled the app
- Bot removed from workspace
Resolution:
- Verify OAuth tokens in Organization Settings → Third Party Integrations (AI SRE)
- Check permission scopes match required permissions
- Confirm workspace access for the authorized user
- Re-authorize the Slack integration if necessary
Channel creation errors
Possible causes:
- Channel name violates Slack naming conventions
- Workspace channel limit reached
- Bot lacks
channels:managepermission
Resolution:
- Check naming conventions: lowercase, no spaces, hyphens allowed
- Verify channel limits in Slack workspace settings
- Confirm bot has
channels:managepermission - Ensure channel name does not already exist
Rate limit errors
Possible causes:
- Runbook sending too many messages in short period
- Multiple runbooks executing simultaneously
- Slack API rate limits exceeded
Resolution:
- Add delays between message actions in runbook
- Consolidate multiple messages into single Block Kit message
- Review Slack API rate limits: api.slack.com/docs/rate-limits
- Implement conditional logic to reduce message frequency
Quick Reference
Block Kit Structure Comparison
| Feature | Section Block | Context Block |
|---|---|---|
| Text Size | Standard | Smaller, compact |
| Text Color | Black | Gray |
| Use Case | Primary content | Supplementary info |
| Structure | Single text object | Array of elements |
| Markdown | ✅ Supported | ✅ Supported |
Common Block Kit Patterns
Simple Alert:
[{"type": "section", "text": {"type": "mrkdwn", "text": "Alert message"}}]
Alert with Metadata:
[
{"type": "section", "text": {"type": "mrkdwn", "text": "Main message"}},
{"type": "context", "elements": [{"type": "mrkdwn", "text": "Metadata"}]}
]
Multi-Section with Divider:
[
{"type": "section", "text": {"type": "mrkdwn", "text": "Section 1"}},
{"type": "divider"},
{"type": "section", "text": {"type": "mrkdwn", "text": "Section 2"}}
]
Essential Variables
| Variable | Description | Example Output |
|---|---|---|
{{Activity.id}} | Incident ID | INC-12345 |
{{Activity.title}} | Incident title | Database Connection Failure |
{{Activity.severity.id}} | Severity level number | 1, 2, 3 |
{{Activity.status}} | Current status | Investigating, Resolved |
{{Activity.service}} | Affected service | api-gateway |
Useful Slack Markdown
| Format | Syntax | Example |
|---|---|---|
| Bold | *text* | *Critical* |
| Italic | _text_ | _investigating_ |
| Strike | ~text~ | ~resolved~ |
| Code | `text` | `error_code` |
| Link | <URL|text> | <https://example.com|Dashboard> |
| Mention | <@USER> | <@U12345> |
| Channel | <!channel> | <!channel> |
Resources
- Slack Block Kit Builder: api.slack.com/block-kit/building
- Block Kit Reference: api.slack.com/reference/block-kit
- Slack Markdown Reference: api.slack.com/reference/surfaces/formatting
- JSON Validator: jsonlint.com
Next Steps
- Go to Slack Commands to learn about Slack slash commands for incident management.
- Go to Configure Microsoft Teams Integration to set up Microsoft Teams notifications.
- Go to Configure Zoom Integration to create incident war rooms.
- Go to Create a Runbook to build automated response workflows.