harmbench.org · Safety & Evals
Standardised evaluation framework for automated red teaming and measuring model refusal robustness.
HarmBench is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// related
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7k
PyRITgithub.comMicrosoft's Python Risk Identification Toolkit for automating red teaming of generative AI systems.Safety & EvalsOpen source★ 121
ARC Prizearcprize.orgNonprofit competition built around the ARC-AGI benchmarks, which test fluid reasoning on puzzles that are easy for people and hard for AI.Safety & EvalsFree★ 746
Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 3.1k
Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.6kNeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.Safety & EvalsOpen source★ 7.4k