> For the complete documentation index, see [llms.txt](https://developer.harness.io/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://developer.harness.io/resilience-testing/chaos-engineering/use-chaos-engineering/probes/apm-probes/splunk-probe.md).

# Splunk observability probe

The Splunk Observability probe allows you to query Splunk Observability(Signalfx) metrics and compare the results against specified criteria.

#### Prerequisites <a href="#prerequisites" id="prerequisites"></a>

To use the Splunk Observability probe, you need:

* An active Splunk Observability(signalfx) account
* Access to the Splunk Observability API from the kubernetes execution plane
* An API token for authentication

#### Interactive Setup Guide <a href="#interactive-setup-guide" id="interactive-setup-guide"></a>

Follow along with this interactive guide to learn how to configure Splunk Observability probe:

{% embed url="<https://app.tango.us/app/embed/e1f8d801-e55a-4e1d-a831-75b1d1a48142?skipCover=false&defaultListView=false&skipBranding=false&makeViewOnly=false&hideAuthorAndDetails=true>" %}
Create Splunk Observability APM Probe
{% endembed %}

#### Steps to configure <a href="#steps-to-configure" id="steps-to-configure"></a>

1. In Resilience probe section under chaos module, click on **New Probe** button

   ![Create Splunk Probe](/files/MK4Bzg8FNimFeFOlq1Y8)
2. Select the **APM Probe**
3. Provide the name of the probe and select **Splunk Observability** under APM Type

   ![Select Splunk Observability Probe](/files/14drLMxRqz32BOW0E7qJ)
4. Under Splunk Observability connector select connector
5. In Connector settings, you can either choose an existing connector or click **New Connector**

   ![Create Splunk Connector](/files/LKAkpYBNtpOPjiR5IfOy)
6. Provide the credentials of the Splunk Observability

   ![Splunk Credentials](/files/qbAcSgbbhGPjvXvUPqDs)
7. Select the delegate and verify the connection and click on Finish

   ![Delegate](/files/Sy1MwnHdJLArw9NnKo8i)
8. Now connector is created and selected, click on Configure Details

   ![Configure Details](/files/zaEgjTn3ioPHIvQol7eX)
9. Under Probe Properties, Pass the value of Splunk Observability Query and Lookback Window

   * **Splunk Observability Query**:
     * The Splunk Observability Query input is a string that specifies the search criteria for the metric time series (MTS) you want to retrieve. It follows a specific syntax that allows you to search for metrics, dimensions, properties, and tags
     * **Example query**: `sf_metric:cpu.utilization AND host.name:gke-default-pool-667be17c-t588.c.test.internal`
     * For more details refer to query section in [Splunk Observability doc](https://dev.splunk.com/observability/reference/api/retrieve_timeserieswindow/latest)
   * **LookBack Window (In Minutes)**:
     * The lookback window refers to the time range from a specified number of minutes ago up to the current moment, over which data is aggregated

   ![Lookback Window](/files/Tjl24id5R7p18YYDpGwV)
10. Provide the comparison criteria under Splunk Observability Data Comparison

    ![Splunk Data Comparison](/files/yAycsVAzPmqZWZTTxzQb)
11. Provide the Run Properties

    ![Run Properties](/files/BDEDMcCQhnQTPquHPbwZ)
12. Then click on **Create Probe**