Back to benchmarks & research
rerank-bench-jev project preview
Benchmarks & research

rerank-bench-jev

Production reranker benchmark: TypeSafe Jev vs Qwen3-Reranker-0.6B on BEIR SciFact and NFCorpus — nDCG@10, cost/query and p50/p95 latency. Quality is indistinguishable; Jev is ~2x faster, Qwen ~4x cheaper. From the team at denser.ai

Explore repositoryVisit website

How it uses Jev

Should you use TypeSafe's Jev — a "System One" model that returns calibrated probabilities instead of text — as a production reranker , or a dedicated cross-encoder?

Languages
Python 95% · Shell 5%
License
Apache-2.0
Last activity
Sep 2026
Added
2026-09-23
Stars at snapshot
1
Status
Community listing

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README · the project website.

Listed in Jev Library

If this is your project, the badge below links back to this page. Paste it near the top of your README.

[![Listed in Jev Library](https://jevlibrary.dev/api/badge/denser-org-rerank-bench-jev)](https://jevlibrary.dev/projects/denser-org-rerank-bench-jev)

Something wrong on this page, or would you rather not be listed? Tell us and it will be changed.

  • jev-eval-agent project preview
    Benchmarks & research

    jev-eval-agent

    Personal-assistant agent built on Vercel's eve with 100 mocked tools, measuring how many steps it takes when Jev picks the tool versus the LLM.

    HTML 105Details
  • typesafe-ai-benchmark project preview
    Benchmarks & research

    typesafe-ai-benchmark

    This is a LLM Gateway that mimics typesafe ai structured output. Like an imposter Jev.

    TypeScript 38Details
  • jev-on-a-laptop project preview
    Benchmarks & research

    jev-on-a-laptop

    Unofficial study: Jev-style parallel typed decisions on stock 1.5B-8B models on an Apple Silicon laptop. Benchmarks, research notes, and a Hugging Face Space demo.

    Python 23Details
  • jev-benchmarks project preview
    Benchmarks & research

    jev-benchmarks

    Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.

    Python 17Details
  • jev-lm project preview
    Benchmarks & research

    jev-lm

    A word-level language model whose output layer is Jev: n-gram drafter, Noul chunk verification, bits-per-token eval

    TypeScript 6Details
  • decider project preview
    Benchmarks & research

    decider

    One-pass typed decisions with calibrated probabilities (System One style model), fine-tuned from Qwen3.5-2B

    Python 351Details