sys1
System One compatible API for open decision models, e.g. Laya, written in Rust.
System One compatible API for open decision models, written in Rust.
How it uses Jev
System One compatible API for open decision models, written in Rust.
Highlights
- tokio , axum and serde , the usual suspects
- System One compatible API Spec
- candle with tokenizers release candidate!
- Dynamic, token-based batching
- SDPA on CPU, Metal, and CUDA
- Flash Attention on Ampere, Ada Lovelace, and Hopper
- Languages
- Rust 96% · Dockerfile 3% · Shell 1%
- License
- NOASSERTION
- Latest release
- v0.0.3
- Last activity
- Sep 2026
- Added
- 2026-09-24
- Stars at snapshot
- 31
- Status
- Community listing
Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.