Etalon qualification evidence · sample
QUALIFIED
This is a labeled synthetic sample of an Etalon evidence report. It was produced against a local scripted fixture, not a customer production model.
What this sample shows
| Decision | QUALIFIED — the fixture path recorded this decision. It is not permission to use a model without human review. |
|---|---|
| Coverage | 1.0 under value-presence (not a cross-product of coverage cells) |
| Critical misroute rate | 0 observed / maximum 0.0 |
| Requirement rows | label accuracy · response schema · abstention correctness |
| Use case | Synthetic ticket-routing classification |
A full interactive report also includes methodology, limitations, requalification triggers, and redacted sensitive-case handling. This page is the credentials-free preview.
Limitations (read before drawing conclusions)
- Scripted local fixture endpoint — not evidence of production LLM or quantization quality.
- Pack qualification is not a regulation, contract, or internal-control determination.
- Out of scope for this pack: free-text generation quality, multilingual inputs, latency/throughput, unattended action.
- Reproduce it with the unassisted sequence:
etalon pack init --from demo ./demo-packwritesdemo-pack/mock_endpoint.py, then that local fixture, then qualify. PyPIetalon==0.0.2does not write the fixture.
Try the short entry (install + pack)
python3 -m venv .venv && source .venv/bin/activate
pip install -e .
# or, instead of the editable install, a wheel from this checkout:
# python3 -m build && pip install dist/etalon-0.0.2-*.whl
etalon --version
etalon pack init --from demo ./demo-pack
python3 demo-pack/mock_endpoint.py --port 8000