local-jev
A local, offline System One server compatible with TypeSafe's Jev API. It answers typed yes/no, category and score questions with small open models.
How it uses Jev
A local, offline System One server. Software that needs a decision rather than prose (which queue, how severe, is this spam) sends a piece of text and some typed questions, and gets back a choice, a score or a yes/no, each with a probability for every possible answer. local-jev speaks exactly the wire format of TypeSafe's hosted Jev API, so the official SDK and existing client code work unchanged, but the models run…
Getting started
- Python 3.10 or newer, and uv (or plain pip ). - macOS on Apple Silicon, Linux, or Windows through WSL2. A CUDA GPU or an Apple GPU is recommended; the CPU works, slowly. All published numbers come from an Apple M4 Max. - Disk and memory for the models you use: 0.87 GB for the smallest ( nli-deberta-large ), 9.32 GB…
- Languages
- Python 65% · JavaScript 19% · CSS 7% · HTML 6%
- License
- MIT
- Last activity
- Sep 2026
- Added
- 2026-09-22
- Stars at snapshot
- 8
- Status
- Community listing
Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.