typesafe-local
Inspired by TypeSafe Ai, Ask a local LLM typed questions, get calibrated probabilities instead of text. Structured output without generation or parsing. MLX / Apple Silicon.
How it uses Jev
TypeSafe shipped a model that returns typed decisions instead of prose, and the idea was interesting enough that I wanted to know how much of it comes from the model and how much from the way it is served. So I built one, on top of an off-the-shelf local model, and measured it.
Getting started
The model ( 1.1 GB) downloads on first run into .hf cache/ inside this folder . ./cleanup.sh --yes removes everything; nothing is written elsewhere.
Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.


