FFirasSX914Benchmarks & research

calibre

Calibration and confidence-based routing measured on Banking77: 80.2% accuracy at $0.103 per 500 decisions

Explore repository

Measure when to use Jev and other models on your data, then route accordingly.

Getting started

Five minutes, on your own data. Janus ships no default threshold: it measures one.

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.

Keep exploring

Similar to calibre

Browse all
jev-benchmark (themsquared) project preview

jev-benchmark (themsquared)

Benchmarks & research
Reproducible benchmark for TypeSafe AI's Jev on agent tool-call risk classification: accuracy, latency, and whether the confidence score is worth routing on.
TMade bythemsquared1
jev-guardrails project preview

jev-guardrails

Benchmarks & research
Comparing LLM-as-judge vs TypeSafe Jev for agent guardrails: same rules, same agent, measured on cost, latency, calibration and coverage.
DMade bydeepansh-saxena3
jev-phishing-bench project preview

jev-phishing-bench

Benchmarks & research
Jev (TypeSafe) vs Claude Haiku 4.5 on 2 000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark.
AMade byanisselbd5
jev-agent-skill-router project preview

jev-agent-skill-router

Agent tooling
Typed, confidence-aware agent skill routing with TypeSafe Jev.
GMade byGodsBoy17
switchboard project preview

switchboard

Agent tooling
Guardrail + model router for LLM gateways on TypeSafe's Jev (System One model), with an independent accuracy/calibration/latency evaluation. Stdlib Python.
AMade byaniruddh-krovvidi0
tink-route project preview

tink-route

Agent tooling
Dynamic, confidence-aware Agent Skill routing with TypeSafe Jev and Tink
JMade byjon-devlapaz4
hermes-jev-skills project preview

hermes-jev-skills

Browser & computer use
Jev-powered model routing, memory, compaction, skill selection, computer and browser use for Hermes agents (also Claude Code and Codex)
KMade bykerpopule726
jev-ultrafast-mcp project preview

jev-ultrafast-mcp

Browser & computer use
Hand the browser work off: an MCP server where a decision model drives the page for your agent, so a flow costs one tool call instead of a turn per click. Ref-based element tables, code-checked assertions, zero-model macro replay. Speaks CDP to your Chrome.
JMade byjiawei68615
jev-ids project preview

jev-ids

Demos & playgrounds
Blazing-Fast Token-Efficient Intrusion Detection System (IDS) based on TypeSafe's Jev
JMade byjev-ids3