SDK Reference

Reference documentation for the harness-evals Python SDK.

The harness-evals Python SDK is the code-first path to defining datasets, evals, scorers, and targets, and running them locally or in CI.

---

What you will learn

• How to install and configure the SDK.

• How to define datasets, evals, and custom scorers in Python.

• How to run evals locally with pytest and forward results to the control plane.