jev-ood-calibration

Independent calibration test of TypeSafe's Jev on a task it cannot have seen: 900 rule-generated support tickets (choice / score / boolean) plus 3 public benchmarks via Vercel AI Gateway. Raw responses, ECE with noise floor, temperature refit, per-type sign of miscalibration. Reproducible for ~$0.06.

How it uses Jev

Does Jev know when it doesn't know?

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.

Keep exploring

Similar to jev-ood-calibration

Browse all
jev-benchmarks project preview
Benchmarks & research
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
minojev project preview
Benchmarks & research
Independent Jev-style replica with head training: a frozen Qwen3-1.7B backbone plus a small trained decision head returns calibrated Choice/Boolean/Score distributions in one forward pass, with committed datasets and a same-backbone generation benchmark.
jev-phishing-bench project preview
Benchmarks & research
Jev (TypeSafe) vs Claude Haiku 4.5 on 2 000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark.
jev-model-router project preview
Agent tooling
Jev (TypeSafe) model router on the Vercel AI Gateway
switchboard project preview
Agent tooling
Guardrail + model router for LLM gateways on TypeSafe's Jev (System One model), with an independent accuracy/calibration/latency evaluation. Stdlib Python.
lanebreak project preview
Demos & playgrounds
LaneBreak — support ticket priority+routing via TypeSafe Jev
jevplayground project preview
Browser & computer use
Browser-only playground for Jev (TypeSafe AI's decision model) via Vercel AI Gateway
typesafe-triage-guard project preview
Three composable judgment pipelines on TypeSafe's Jev: support-ticket triage, observability alert triage, and a deploy-risk gate.
systemANE project preview
Applications
Using Apple's Neural Engine as a fast and free local "System One" Decision Engine (macOS 27) - "Honey, we have Jev at home"