lastexam.ai · Safety & Evals
Expert written benchmark of very hard questions across dozens of subjects, built to measure progress at the frontier of knowledge.
Humanity's Last Exam is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// related
ARC Prizearcprize.orgNonprofit competition built around the ARC-AGI benchmarks, which test fluid reasoning on puzzles that are easy for people and hard for AI.Safety & EvalsFree★ 746
HarmBenchharmbench.orgStandardised evaluation framework for automated red teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1k
Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 3.1k
Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.6k
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7k
NeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.Safety & EvalsOpen source★ 7.4k