jev-curate
High-throughput synthetic & pretraining dataset sifter powered by TypeSafe AI Jev (api.typesafe.ai). Stream, filter, and score Parquet & JSONL datasets at 1,500+ rows/sec using System One typed decisions (Choice, Score, Noul).
High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
How it uses Jev
High-Throughput Synthetic & Pretraining Dataset Sifter Powered by TypeSafe AI (Jev)
Getting started
Install (pick your OS) OS Rust Python --- --- --- Linux cargo install jev-curate or gh release download tar.gz pip install jev-curate (manylinux wheel) macOS cargo install or tar.gz (x86 64 + arm64) pip install (universal2 wheel) Windows cargo install or zip pip install (win wheel) bash
Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README · the project website.