guardrailsai.com · Safety & Evals
Framework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.
Guardrails AI is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// related
NeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.Safety & EvalsOpen source★ 7.4k
Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 3.1k
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7kPurple Llamagithub.comMeta's umbrella project for open trust and safety tools, including Llama Guard classifiers and CyberSecEval benchmarks.Safety & EvalsOpen source★ 4.4k
HarmBenchharmbench.orgStandardised evaluation framework for automated red teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1kPyRITgithub.comMicrosoft's Python Risk Identification Toolkit for automating red teaming of generative AI systems.Safety & EvalsOpen source★ 121