arcprize.org · Safety & Evals
Nonprofit competition built around the ARC-AGI benchmarks, which test fluid reasoning on puzzles that are easy for people and hard for AI.
ARC Prize is one of 10 safety and eval tools on Intelsi. See all safety and eval tools or how we check facts.
// guides
AGI vs LLM explained: an LLM is a kind of AI model that predicts text, while AGI is a goal for human level general ability. See where today's chatbots sit.
Has AGI been achieved? What OpenAI really said about GPT-6 Astra, how AGI is defined, the evidence on each side, and what a formal declaration would change.
// related
Humanity's Last Examlastexam.aiExpert written benchmark of very hard questions across dozens of subjects, built to measure progress at the frontier of knowledge.Safety & EvalsFreeHN 1
HarmBenchharmbench.orgStandardised evaluation framework for automated red teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1k
Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 3.1k
Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.6k
garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.7k
NeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact checking and safe dialog flows.Safety & EvalsOpen source★ 7.4k