Open-source โ€” Veriscope

Epistemic Infrastructure for Reliable AI

Detect neural network training pathologies before they compound into brittle or unsafe behavior. Veriscope provides early-warning detection with auditable, evidence-based gating.

Veriscope is a research framework for detecting soft collapse, mode collapse, and gradient instabilities in neural network training.

Detect Problems Before They Compound

Veriscope identifies training pathologies where standard metrics look healthy but internal representations are degrading.

๐Ÿ“

Geometric Analysis

Monitor effective dimension and variance distribution across eigenspaces to detect representational collapse early.

๐Ÿ“ˆ

Dynamical Monitoring

Track entropy gradients and gradient noise scale to identify instabilities in training dynamics.

๐Ÿ“Š

Distributional Tracking

Compute sliced Wasserstein-2 and total variation distances to catch distribution drift during training.

๐Ÿ”—

Topological Analysis

Optional H0 persistence computation via Ripser for advanced structural analysis of learned representations.

โœ…

Auditable Decisions

Every pass/fail decision includes explicit reasons and artifacts suitable for compliance and post-hoc review.

๐ŸŽฏ

Regime-Anchored Drift

Separate short-horizon change detection from sustained deviation relative to healthy reference regimes.

The Criterion Protocol

Monitoring as an auditable decision contract. Declare observable windows, calibrate healthy ranges, and enforce sensitivity budgets with full accountability.

  • โœ“Prequential gain checks with configurable thresholds
  • โœ“Stability verification with finite-evidence uncertainty
  • โœ“Sensitivity budget enforcement for training safety
  • โœ“Full provenance tracking and artifact generation
# GateEngine Decision Flow

def evaluate_gate(metrics):
    # Gain check
    assert prequential_gain >= threshold

    # Stability check
    assert D_W(past, recent) <= ฮต - ฮต_stat

    # Sensitivity budget
    assert ฮบ_sens <= ฮต_sens

    return Decision(
        status="PASS",
        reasons=reasons,
        artifacts=artifacts
    )
Python 3.9+
Runtime
PyTorch 1.13+
Framework
CPU & GPU
Compute
Dual License
AGPL + Commercial

Get Started with Veriscope

Open-source under AGPL-3.0. Commercial licensing available for organizations.