> ## Documentation Index
> Fetch the complete documentation index at: https://hydroxai.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.
# AI Benchmarks Directory
> A comprehensive guide to the most influential AI benchmarks — understand how frontier models are evaluated across software engineering, reasoning, agents, science, and more.
AI benchmarks are standardized tests that measure how well a model performs on specific tasks. They are essential for comparing models, tracking progress, and identifying weaknesses before deployment.
This directory covers the most impactful benchmarks across multiple categories — from code generation to scientific reasoning to agentic capabilities.
## Benchmark Categories
Code generation, debugging, terminal operations, and real-world software tasks.
Abstract reasoning, logic puzzles, and general problem-solving ability.
Autonomous task execution, tool use, multi-step planning, and agent reliability.
Scientific reasoning, domain expertise, and world knowledge.
Deep research, long document comprehension, and multi-source synthesis.
Mathematical reasoning, proof generation, and numerical problem solving.
Vision-language understanding, image reasoning, and cross-modal tasks.
Creative writing, text generation quality, and stylistic control.
Strategic gameplay, rule following, and interactive decision-making.
***
## Software Engineering
Benchmarks that test a model's ability to write, debug, and maintain real-world software.
Resolve real GitHub issues from popular open-source Python projects. The gold standard for evaluating AI coding assistants.
Execute complex multi-step terminal operations — file management, system administration, and scripting tasks.
**Why it matters:** Software engineering benchmarks test practical coding ability in realistic settings. High scores here directly correlate with how useful a model is as a coding assistant.
***
## Reasoning & General Intelligence
Benchmarks that measure abstract reasoning, logic, and general problem-solving capabilities.
Deceptively simple questions that expose spatial, social, and logical reasoning failures in frontier models.
Abstract visual pattern recognition and reasoning — the benchmark designed to measure genuine intelligence vs. memorization.
3,000 expert-level questions across 100+ academic disciplines. The hardest multi-domain benchmark ever created.
**Why it matters:** Reasoning benchmarks reveal whether a model truly "understands" or is just pattern-matching. They are the best predictors of general capability.
***
## Agent
Benchmarks that evaluate autonomous task execution, tool use, and multi-step planning.
Tests agentic capabilities across diverse real-world tasks — tool use, planning, error recovery, and autonomous execution.
**Why it matters:** As AI systems move from chat assistants to autonomous agents, agentic benchmarks are critical for measuring reliability and safety in production environments.
***
## Science & Knowledge
Benchmarks that test scientific reasoning, domain expertise, and factual knowledge.
Geospatial reasoning and geographic knowledge — mapping, spatial analysis, and Earth science understanding.
**Why it matters:** Science benchmarks assess whether models can serve as reliable research assistants and domain experts across scientific fields.
***
## Long Context & Research
Benchmarks that test the ability to process long documents, synthesize multiple sources, and conduct deep research.
Multi-source research synthesis requiring models to gather, analyze, and reason across large bodies of information.
**Why it matters:** Long context benchmarks are essential for understanding whether models can handle real-world tasks like literature review, legal analysis, and investigative research.
***
## Mathematics
Benchmarks focused on mathematical reasoning, theorem proving, and numerical problem-solving.
Popular benchmarks in this category include **MATH**, **GSM8K**, **MathVista**, **OlympiadBench**, and **Minerva**. These test everything from grade-school arithmetic to competition-level mathematics.
***
## Multimodal
Benchmarks that evaluate vision-language understanding, image reasoning, and cross-modal capabilities.
Popular benchmarks include **MMMU**, **MathVista**, and **MEGA-Bench**. These evaluate how well models can jointly reason about text, images, charts, and diagrams.
***
## Writing & Creativity
Benchmarks that assess creative writing quality, stylistic control, and text generation capabilities.
Popular benchmarks include **CreativeBench** and **WritingBench**. These test narrative quality, coherence, and the ability to follow creative constraints.
***
## Games
Benchmarks that test strategic gameplay, rule comprehension, and interactive decision-making.
Popular benchmarks include **GameBench**, **NetHack**, and **PokemonBench**. These evaluate planning ability and strategy in complex interactive environments.
***
## All Benchmarks at a Glance
| Benchmark | Category | Difficulty | Key Metric | Top Score (2026) |
| ----------------------------------------------------------- | ----------------------- | ----------- | ---------------------- | ---------------- |
| [SWE-bench](/eval-benchmark/swe-bench) | Software Engineering | Hard | % Issues Resolved | \~65% (Verified) |
| [Terminal-Bench 2.0](/eval-benchmark/terminal-bench) | Software Engineering | Hard | Task Completion Rate | \~45% |
| [SimpleBench](/eval-benchmark/simplebench) | Reasoning | Medium | Accuracy % | \~83% |
| [ARC-AGI-2](/eval-benchmark/arc-agi-2) | Reasoning | Very Hard | Accuracy % | \~40% |
| [Humanity's Last Exam](/eval-benchmark/humanitys-last-exam) | Reasoning / Knowledge | Very Hard | Accuracy % | \~25% |
| [APEX-Agents](/eval-benchmark/apex-agents) | Agent | Hard | Task Success Rate | \~55% |
| [GeoBench](/eval-benchmark/geobench) | Science | Medium-Hard | Accuracy % | \~70% |
| [DeepResearchBench](/eval-benchmark/deep-research-bench) | Long Context / Research | Hard | Research Quality Score | \~60% |
Scores are approximate and evolve rapidly as new models are released. Check each benchmark's leaderboard for the latest results.
## Next Steps
Use Know Your AI to evaluate your model against security and safety benchmarks.
Explore 50+ attack datasets for red-teaming and adversarial evaluation.