Skip to main content
verifiers runs locally with uv. Install uv, clone the repository, and sync dependencies:
The checkout installs the example tasksets right away, so you can verify your setup with a local check that doesn’t call a model:
To run a few episodes against a model, use uv run vf-run reverse-text -n 2 -r 1. For full model evaluations, use uv run eval in prime-rl. To work with other tasksets, including packages you build yourself following building environments, install them into the environment first (for example, uv pip install -e environments/<package_dir>) so the CLI can resolve their IDs. Harbor-based tasksets require Python 3.12+ and the harbor extra (uv sync --extra harbor).

​
Commands

verifiers installs four CLI commands, which you run with uv run in the environment where verifiers and your taskset package are installed: Pass --help to any command to inspect its flags. Because tasksets and harnesses register their own options dynamically, include the taskset ID before --help to see the taskset’s flags.