jev-phishing-bench

Jev (TypeSafe) vs Claude Haiku 4.5 on 2 000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark.

Jev (TypeSafe) vs Claude Haiku 4.5 on 2,000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark by Anisse Lebadi.

How it uses Jev

Jev vs LLM: a phishing decision benchmark with a calibration audit

Source: community catalog. Details and metrics reflect the published community snapshot and are not a performance endorsement. Documentation details extracted from GitHub · the README · the project website.

Keep exploring

Similar to jev-phishing-bench

Browse all
jev-benchmarks project preview
Benchmarks & research
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
jev-rag-benchmark project preview
Benchmarks & research
Reproducible benchmark for measuring Jev reranking quality, latency, and cost in RAG
jev-benchmark (themsquared) project preview
Benchmarks & research
Reproducible benchmark for TypeSafe AI's Jev on agent tool-call risk classification: accuracy, latency, and whether the confidence score is worth routing on.
switchboard project preview
Agent tooling
Guardrail + model router for LLM gateways on TypeSafe's Jev (System One model), with an independent accuracy/calibration/latency evaluation. Stdlib Python.
Jev-Moderation-Bot project preview
Applications
Real-time Discord moderation bot: Jev evaluates messages and metadata in parallel to catch phishing, spam, and social engineering with a progressive escalation ladder.
typesafe-jev-workflow project preview
Async LangGraph workflow that gets a typed Jev Choice (invoice or general) and routes each inbound email to the matching handler.
jevmail project preview
Integrations
Open-source AI email triage for Gmail. Sorts your inbox into Needs reply, Updates, Promos, Sales and Spam with Jev, TypeSafe AI's decision model, via Vercel AI Gateway. Read-only, runs locally, 1,000 emails in about a minute for 3 cents.
jev-mailroom project preview
Agent tooling
Email triage PoC: reads a mailbox over IMAP and classifies each message by what it is and what it's about, using TypeSafe System One (Jev) — 11 questions in a single call, decided in Python.
jev-gmail-ai-spam-filter-and-labeling project preview
Self-hosted AI email classifier for Gmail powered by Jev. Create custom labels, organize your inbox, and filter spam with confidence and cost controls.