every-leaderboards / README.md
SaylorTwift's picture
SaylorTwift HF Staff
Migrate to Gradio app with interactive features
fa808e0 verified
|
Raw
History Blame Contribute Delete
3.41 kB

A newer version of the Gradio SDK is available: 6.28.0

Upgrade
metadata
title: Official Benchmarks Leaderboard 2026
emoji: πŸ†
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 5.50.0
app_file: app.py
pinned: false

πŸ† Official Benchmarks Leaderboard 2026

A unified leaderboard for 11 official HuggingFace benchmarks. Compare AI models across math, coding, knowledge, vision, agent, and language tasks.

✨ Features

  • πŸ“Š 11 Official Benchmarks: GSM8K, MMLU-Pro, GPQA, HLE, SWE-bench, AIME, HMMT, and more
  • πŸŽ›οΈ Quick Filters: One-click presets for model sizes and benchmark categories
  • πŸ” Interactive Search: Filter by model name or provider
  • πŸ“ Size Range Slider: Filter models by parameter count (0-1100B+)
  • 🎯 Category Selection: Choose specific benchmark categories to display
  • πŸ“₯ Export CSV: Download filtered leaderboard data
  • πŸ”„ Sortable Columns: Click any header to sort the table
  • 🎨 Modern Design: Clean, responsive interface with provider logos

🎯 Benchmarks Included

πŸ“ Math

  • GSM8K: Grade School Math (8.5K problems)
  • AIME 2026: American Invitational Mathematics Examination
  • HMMT 2026: Harvard-MIT Mathematics Tournament

🧠 Knowledge

  • MMLU-Pro: Massive Multi-task Language Understanding
  • GPQA Diamond: PhD-level expert questions
  • HLE: Humanity's Last Exam

πŸ’» Coding

  • SWE-bench Verified: Real-world software engineering tasks
  • SWE-bench Pro: Advanced software engineering challenges

πŸ‘οΈ Vision

  • olmOCR: OCR evaluation benchmark

πŸ€– Agent

  • Terminal-Bench 2.0: Terminal command understanding

πŸ’¬ Language

  • EvasionBench: Language understanding challenges

πŸš€ Quick Start

The leaderboard loads automatically from the HuggingFace dataset: OpenEvals/leaderboard-data

Quick Filters:

  • πŸ”Ή Small (<10B), πŸ”Έ Medium (10-100B), πŸ”Ά Large (100B+) - Filter by model size
  • πŸ’» Coding, 🧠 Knowledge, πŸ“ Math, etc. - Show only specific categories

πŸ“Š Data Source

Dataset: OpenEvals/leaderboard-data

All scores are aggregated from official HuggingFace benchmark leaderboards. The dataset is updated regularly with the latest model evaluations.

πŸ’» Local Development

# Install dependencies
pip install -r requirements.txt

# Run the app
python app.py

πŸ“ Project Structure

.
β”œβ”€β”€ app.py                    # Main Gradio application
β”œβ”€β”€ utils/
β”‚   β”œβ”€β”€ data_loader.py       # Load data from HuggingFace dataset
β”‚   β”œβ”€β”€ filters.py           # Filter and search logic
β”‚   β”œβ”€β”€ formatters.py        # Data formatting utilities
β”‚   └── html_generator.py    # Generate HTML leaderboard table
β”œβ”€β”€ static/
β”‚   └── sortTable.js         # Client-side table sorting
β”œβ”€β”€ data/
β”‚   └── provider_logos.json  # Provider avatar URLs
└── requirements.txt         # Python dependencies

πŸ”§ Technologies

  • Gradio 5.50.0: Interactive web interface
  • Datasets: HuggingFace datasets library
  • Pandas: Data manipulation
  • RangeSlider: Custom Gradio component for size filtering

πŸ“ License

Data is sourced from official HuggingFace benchmarks. Please refer to individual benchmark pages for specific licensing information.


Made with ❀️ by the Benchmarks Team