Kubernetes Custom Script Action Templates
Pre-built Custom Script Action templates for integrating observability and monitoring tools with your chaos experiments. These templates help you quickly set up actions to annotate dashboards, create events, and enhance visibility during chaos injection.
Here are Custom Script action templates that you can use in your chaos experiments.
Grafana Chaos Annotation
Grafana chaos annotation action annotates the grafana dashboard to highlight the chaos duration.
Required Environment Variables:
GRAFANA_URL: URL of the Grafana instanceGRAFANA_USERNAME: Username for Grafana authenticationGRAFANA_PASSWORD: Password for Grafana authenticationDASHBOARD_UID: Dashboard UID of the Grafana instanceMODE: Mode of operation (SOT, EOT, or Continuous)ADDITIONAL_TAGS: Additional tags for the annotation (optional)
Use cases
- Visualize chaos injection periods on Grafana dashboards
- Correlate chaos events with metrics and alerts
- Track experiment timeline alongside application performance
- Improve incident analysis and debugging
Datadog Chaos Event
It creates an event for the datadog dashboard to highlight the chaos injection.
Required Environment Variables:
DATADOG_URL: URL of the Datadog instanceDATADOG_API_KEY: Datadog API key for authenticationDATADOG_EVENT_TITLE: Title of the eventDATADOG_EVENT_TEXT: Text description of the chaos eventMODE: Mode of operation (start or end, default: start)DATADOG_EVENT_TAGS: Comma-separated tags for the event (optional)DATADOG_EVENT_ALERT_TYPE: Alert type (info, warning, error, success, default: info)
Use cases
- Create events in Datadog to mark chaos experiment execution
- Track chaos injection alongside application metrics
- Enable correlation between chaos and system behavior
- Enhance observability during resilience testing