jev-rag-benchmark

Reproducible benchmark for measuring Jev reranking quality, latency, and cost in RAG

How it uses Jev

- The candidate pool is the historical hybrid BM25 + BGE-M3 baseline's top 20, frozen once. - Jev, Cohere, Clef Flash and Luna Decisions receive identical candidate texts and order for every question. - All rerankers return five passages. The baseline retains the original hybrid order. - Clef Flash is reported separately for 20-question batch and one-passage-per-request scoring; Jev 1.13 is the original batch run, J…

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.

Keep exploring

Similar to jev-rag-benchmark

Browse all
jev-phishing-bench project preview
Benchmarks & research
Jev (TypeSafe) vs Claude Haiku 4.5 on 2 000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark.
jev-benchmarks project preview
Benchmarks & research
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
jev-benchmark (themsquared) project preview
Benchmarks & research
Reproducible benchmark for TypeSafe AI's Jev on agent tool-call risk classification: accuracy, latency, and whether the confidence score is worth routing on.
jev-reranker project preview
Applications
Jev-powered relevance filtering and reranking for RAG in Python.
jev-review (NiazMorshed2007) project preview
Local-first MCP plugin for continuous software-quality review by AI coding agents, powered by Jev.
switchboard project preview
Agent tooling
Guardrail + model router for LLM gateways on TypeSafe's Jev (System One model), with an independent accuracy/calibration/latency evaluation. Stdlib Python.
open-alternative-jev project preview
Jev alternatives & open source
Open alternative to Jev: typed, calibrated decisions from any open-weights LLM in one forward pass (HF + vLLM), with benchmarks
jev-suite project preview
Applications
Four decision-quality tools on Jev (TypeSafe System One): Jev answers structured questions, deterministic code keeps the final say.
open-jev (JoshuaSP) project preview
Jev alternatives & open source
Typed JSON inference with DiffusionGemma, with Every and Jev benchmark results