Convex Decision Evals
Leaderboard that puts Jev and 14 LLMs through 108 four-option multiple-choice questions about the Convex backend platform, comparing accuracy, latency, and cost, with a per-answer explorer showing Jev probabilities.
Convex is an open-source, reactive database that's the best platform for full-stack AI coding.
How it uses Jev
Jev uses OpenRouter's /api/alpha/decisions endpoint with native typed questions; the language models use /api/v1/chat/completions . The hosted Jev configuration pins typesafe/jev-1.13 , records the returned model ID, probabilities, confidence, and provider-reported cost, and sends no chat reasoning or output-token settings. All hosted models use the existing OpenRouter credential. Direct TypeSafe trials remain suppo…
Getting started
Add a single standardised test using the helper:
- Languages
- TypeScript 85% · JavaScript 15% · CSS 1%
- License
- Apache-2.0
- Latest release
- Release 0.432.0
- Last activity
- Sep 2026
- Added
- 2026-09-24
- Stars at snapshot
- 0
- Status
- Community listing
Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README · the project website.