# Recorded offline experiments

Generated by `python -m scripts.reproduce_portfolio`. These are actual runs of local rules,
not model performance claims. No API calls were made. Timing depends on the machine.
Download an HTML file and open it locally, or import JSON through the webpage.
Reproduce into an ignored directory with `uv run --locked python -m scripts.reproduce_portfolio`.
The source and grader fingerprints change when implementation changes; recorded reports
are comparable with each other, but may require rerunning to compare with a later checkout.

| Suite | Split | Baseline passes | Improved passes | Regressions | Evidence |
|---|---|---:|---:|---:|---|
| classification | dev | 14/20 | 20/20 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/classification-dev.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/classification-dev.html) |
| classification | holdout | 4/10 | 7/10 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/classification-holdout.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/classification-holdout.html) |
| extraction | dev | 10/20 | 20/20 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/extraction-dev.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/extraction-dev.html) |
| extraction | holdout | 3/10 | 8/10 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/extraction-holdout.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/extraction-holdout.html) |
| tool_calling | dev | 12/20 | 20/20 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/tool_calling-dev.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/tool_calling-dev.html) |
| tool_calling | holdout | 5/10 | 8/10 | 1 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/tool_calling-holdout.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/tool_calling-holdout.html) |
| rag | dev | 2/8 | 8/8 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/rag-dev.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/rag-dev.html) |
| rag | holdout | 1/4 | 1/4 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/rag-holdout.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/rag-holdout.html) |
| response_quality | dev | 3/6 | 5/6 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/response_quality-dev.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/response_quality-dev.html) |
| response_quality | holdout | 2/6 | 1/6 | 1 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/response_quality-holdout.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/response_quality-holdout.html) |
| agent | dev | 4/8 | 8/8 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/agent-dev.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/agent-dev.html) |
| agent | holdout | 1/4 | 4/4 | 0 | [JSON](https://hk-775.github.io/practical-eval-lab/reports/agent-holdout.json) · [HTML](https://hk-775.github.io/practical-eval-lab/reports/agent-holdout.html) |

---
Source: [examples/results/README.md](https://github.com/hk-775/practical-eval-lab/blob/main/examples/results/README.md)

Source SHA-256: `fcb14ad04e14d9305e68b41b4ca81f942b92d2c23a6fcb67fd816833989d946b`