padflow-jev-evals

Typed-decision benchmark from PadFlow (land development SaaS): schemas, anonymized labeled rows, and a runner for confidence-calibrated models like TypeSafe Jev.

How it uses Jev

This repo publishes those decisions as JSON schemas, a labeled set of anonymized examples, and a script that scores any OpenAI-compatible model on them. It exists so a decision model (TypeSafe Jev, or anything else) can be measured against the workload it would replace.

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.

Keep exploring

Similar to padflow-jev-evals

Browse all
openjev-experiments project preview
Benchmarks & research
Experiments with openjev, an open Jev-style option-logit runner, on local models.
jevmlx project preview
Benchmarks & research
Jev-style parallel constrained decisions for any MLX model on Apple Silicon. Typed, schema-valid JSON in one forward pass.
decider project preview
Benchmarks & research
One-pass typed decisions with calibrated probabilities (System One style model), fine-tuned from Qwen3.5-2B
open-alternative-jev project preview
Jev alternatives & open source
Open alternative to Jev: typed, calibrated decisions from any open-weights LLM in one forward pass (HF + vLLM), with benchmarks
jev-agent-skill-router project preview
Typed, confidence-aware agent skill routing with TypeSafe Jev.
jev_jsonschema project preview
Applications
Run a JSON Schema through TypeSafe's Jev API, and get JSON back.
OpenDecision project preview
Applications
OpenDecision is an open-source semantic decision engine like typesafe's jev.
jevper project preview
SDKs & clients
Jev-shaped (TypeSafe System One) classification wrapper over OpenAI-like clients: probabilities and confidence instead of prose
jev-superpowers project preview
Agent tooling
Systematic software development framework for AI coding agents upgraded with TypeSafe Jev System One typed decisions