jev-on-a-laptop
Unofficial study: Jev-style parallel typed decisions on stock 1.5B-8B models on an Apple Silicon laptop. Benchmarks, research notes, and a Hugging Face Space demo.
How it uses Jev
Jev-style decisions on a laptop
Getting started
Windows / NVIDIA GPU: use the released parallel-decisions library's GPU setup and performance guide for installation, configuration and reproducible benchmarks. Our integrated Torch backend supports shared-prefix reuse and optional CUDA Graphs. On separate warmed 0.5B workloads, graphs reduced request latency 60.1 → 5…
Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.