jev-secret-detection

Measures how well TypeSafe's RLCD-Jev model spots real secret credentials in file snippets

How it uses Jev

Measures how well TypeSafe's Jev model spots real secret credentials in file snippets. Each test case is sent to Jev as a single Noul question ("does content contain a real secret credential that someone reading it could use?"), and the returned probability is compared with the expected label.

Getting started

The default run is the 100-case set. Add edge or config ( uv run python main.py config ) to run one of the smaller batches instead.

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README.

Keep exploring

Similar to jev-secret-detection

Browse all
FinancialPredictionJev project preview
Benchmarks & research
Using Jev to test how well it predicts financial markets(just like most llms as of september 2026, it doesnt do that good)
qwen-rlcd project preview
Benchmarks & research
Jev-style calibrated decision model (Choice/Score/Noul) on Qwen3.5-0.8B
jeval project preview
Benchmarks & research
Measures what your Jev classifier's confidence is really worth, and sets the human hand-off line from what a mistake costs.
jev-commit project preview
Agent tooling
Pre-commit hook: one Jev call judges whether your commit message matches the staged diff, plus debug leftovers, unmentioned work, and a credential check.
jev-resume-match project preview
Demos & playgrounds
Score how well a resume matches a job description using Jev (TypeSafe AI). Next.js app that returns typed, explainable match scores instead of generated text.
jev-ids project preview
Demos & playgrounds
Blazing-Fast Token-Efficient Intrusion Detection System (IDS) based on TypeSafe's Jev
JevPromptCoach project preview
Agent tooling
Claude Code plugin that scores how well you prompt a coding agent, and shows whether your habits are improving. Runs on TypeSafe's Jev model. Zero added latency.
Verdict-open-jev project preview
Jev alternatives & open source
Non-autoregressive decision engine on ModernBERT (151M) with calibrated uncertainty (RLCD), TypeSafe AI Jev benchmark audit, and in-browser WebGPU playground
pi-jev-sentinel project preview
Agent tooling
Pi coding-agent extension: TypeSafe Jev checks for tool calls, tool outputs and replies (prompt injection, approvals, secret scrubbing, task pinning)