FfstandhartingerBenchmarks & research

jevbench

JevBench v1 - a benchmark for Jev-class typed decision models: smart, cheap, fast, reliable, open.

Explore repository

JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision accuracy, calibration, latency and cost.

How it uses Jev

Jev is TypeSafe AI's decision model; JevBench also evaluates Jev-compatible systems. The canonical JevBench board is https://benchmarkheaven.com/jev-models.

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README · the project website.

Keep exploring

Similar to jevbench

Browse all
metask-jev project preview

metask-jev

Benchmarks & research
Metask-Jev: calibrated typed-decision models (Jev-class). Single forward pass, candidate-logit readout. metask-jev-4b beats Bespoke Nimble-9B and Jev on JevBench.
MMade bymetask-ai2
reflexbench project preview

reflexbench

Benchmarks & research
ReflexBench — open benchmark and evaluation harness for System One models and typed decision engines
BMade bybrida-ai4
siftr project preview

siftr

Benchmarks & research
Fast, cheap judgment for AI coding agents: semantic search, focused reads and list picking in ~2s. CLI + MCP server on TypeSafe Jev. Benchmarked on SWE-bench.
BMade byBentlybro2
grok-bot-jev project preview

grok-bot-jev

Agent tooling
Connect TypeSafe Jev to Grok Bot as a cheap decision layer - usage gates, skill template, examples
BMade byBodila5178
open-alternative-jev project preview

open-alternative-jev

Jev alternatives & open source
Open alternative to Jev: typed, calibrated decisions from any open-weights LLM in one forward pass (HF + vLLM), with benchmarks
IMade byikermoel53
open-jev (JoshuaSP) project preview

open-jev (JoshuaSP)

Jev alternatives & open source
Typed JSON inference with DiffusionGemma, with Every and Jev benchmark results
JMade byJoshuaSP39
werr project preview

werr

Demos & playgrounds
Zero-memory System-1 decision engine & TypeSafe Jev wire-compatible runtime powered by Mandelbrot wave dynamics (JevBench #1).
PMade bypCwOrM3
hermes-jev-approvals project preview

hermes-jev-approvals

Agent tooling
PoC: TypeSafe Jev as the reviewer for Hermes Agent smart command approvals. 8.7x faster, 4.4x fewer prompts, measured on 153 real commands. Approvals only.
AMade byanpicasso14
jev-smart-router project preview

jev-smart-router

Agent tooling
JEV Smart Router — a Databricks App that uses TypeSafe JEV to pick which model answers each message, then runs inference on the chosen Databricks Foundation Model API endpoint.
RMade byrmosleydb3