github.com · Safety & Evals
Toolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.
NeMo Guardrails is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// related
Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.6k
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7k
Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 3.1kPurple Llamagithub.comMeta's umbrella project for open trust and safety tools, including Llama Guard classifiers and CyberSecEval benchmarks.Safety & EvalsOpen source★ 4.4k
HarmBenchharmbench.orgStandardised evaluation framework for automated red teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1kPyRITgithub.comMicrosoft's Python Risk Identification Toolkit for automating red teaming of generative AI systems.Safety & EvalsOpen source★ 121