Quality evidence plane

Evaluations

Run in Test Console

Release evaluation suites

Application-bound quality gates with golden datasets and explicit dimensions.

3 eligible · 1 blocked

Quality evidence trend

Weighted eval quality, grounding and safety across the last seven release windows.

Above release floor

What blocks production

Release gates combine multiple dimensions instead of relying on one aggregate score.

Task quality

Golden-case and rubric score must meet application floor.

≥94%Required
Grounding

Citations and source evidence cannot regress below route threshold.

≥95%Required
Safety

Critical policy failures immediately block release.

0 criticalHard gate
Operational budget

Cost and latency deltas are reviewed with quality evidence.

Within SLOGuardrail

Recent evaluation runs

Candidate → dataset → model/route → quality → cost/latency → release eligibility.

Open release gates
Run / suiteApplicationCandidate / routeCasesScoreGroundedTool accuracyLatencyCostRegressionRelease