inspect.aisi.org.uk · Safety & Evals
Evaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.
Inspect is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// guides
The UK AI Security Institute explained: who runs it, how it tests frontier models before release, what the 2026 Mythos 5 incident showed and how to use it.
// related
Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.6k
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7k
NeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.Safety & EvalsOpen source★ 7.4kPurple Llamagithub.comMeta's umbrella project for open trust and safety tools, including Llama Guard classifiers and CyberSecEval benchmarks.Safety & EvalsOpen source★ 4.4k
HarmBenchharmbench.orgStandardised evaluation framework for automated red teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1kPyRITgithub.comMicrosoft's Python Risk Identification Toolkit for automating red teaming of generative AI systems.Safety & EvalsOpen source★ 121