github.com · Safety & Evals
Meta's umbrella project for open trust and safety tools, including Llama Guard classifiers and CyberSecEval benchmarks.
Purple Llama is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// guides
What is AI safety? A clear 2026 explainer: the three kinds of AI risk, how safety differs from alignment and security, the main research areas and who does it.
// related
Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 3.1k
Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.6k
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7kNeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.Safety & EvalsOpen source★ 7.4k
HarmBenchharmbench.orgStandardised evaluation framework for automated red teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1kPyRITgithub.comMicrosoft's Python Risk Identification Toolkit for automating red teaming of generative AI systems.Safety & EvalsOpen source★ 121