Automatic Drift Monitoring
CONTINUOUS ASSURANCEScheduled evaluation runs detecting performance degradation, policy drift, and statistical regressions over time.
Active Drift Monitors
1
Evaluating fixed test suite suites on scheduleDegradations Blocked
1
Policy regressions flagged prior to production impactAlert Health
95%PASS
Current baseline pass rate >= 90% thresholdScheduled Evaluation Workers
0 ACTIVE WORKERS| Target Agent & ID | Cadence | Latest Pass Rate | Alert Threshold | Checks Executed | Last Checked | Action |
|---|
Statistical Drift vs Noise Disambiguation
VeriLoop distinguishes transient nondeterminism from confirmed statistical regressions. In small splits (N=20 holdout cases), a single flaky pass alters metrics by 5%. A drift alert triggers only when:
- A critical policy or safety failure occurs (zero-tolerance threshold).
- Two consecutive runs fall below the Wilson 95% confidence lower bound.
- A tool schema mismatch or unhandled exception emerges in previously working probes.