File size: 3,412 Bytes
4171c94
58e6611
 
 
 
fa808e0
 
 
a9acf5a
4171c94
 
fa808e0
a9acf5a
fa808e0
eeed593
fa808e0
eeed593
fa808e0
 
 
 
 
 
 
 
eeed593
fa808e0
eeed593
fa808e0
58e6611
 
fa808e0
eeed593
fa808e0
 
 
 
eeed593
fa808e0
58e6611
 
eeed593
fa808e0
58e6611
eeed593
fa808e0
58e6611
eeed593
fa808e0
 
eeed593
fa808e0
eeed593
fa808e0
eeed593
fa808e0
 
 
eeed593
fa808e0
eeed593
fa808e0
eeed593
fa808e0
eeed593
fa808e0
eeed593
58e6611
fa808e0
 
45498bd
fa808e0
 
90289b1
45498bd
fa808e0
45498bd
eeed593
58e6611
fa808e0
 
 
 
 
 
 
 
58e6611
fa808e0
 
eeed593
 
fa808e0
 
 
 
 
 
 
 
45498bd
58e6611
45498bd
 
 
58e6611
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
---
title: Official Benchmarks Leaderboard 2026
emoji: πŸ†
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 5.50.0
app_file: app.py
pinned: false
---

# πŸ† Official Benchmarks Leaderboard 2026

A unified leaderboard for **11 official HuggingFace benchmarks**. Compare AI models across math, coding, knowledge, vision, agent, and language tasks.

## ✨ Features

- πŸ“Š **11 Official Benchmarks**: GSM8K, MMLU-Pro, GPQA, HLE, SWE-bench, AIME, HMMT, and more
- πŸŽ›οΈ **Quick Filters**: One-click presets for model sizes and benchmark categories
- πŸ” **Interactive Search**: Filter by model name or provider
- πŸ“ **Size Range Slider**: Filter models by parameter count (0-1100B+)
- 🎯 **Category Selection**: Choose specific benchmark categories to display
- πŸ“₯ **Export CSV**: Download filtered leaderboard data
- πŸ”„ **Sortable Columns**: Click any header to sort the table
- 🎨 **Modern Design**: Clean, responsive interface with provider logos

## 🎯 Benchmarks Included

### πŸ“ Math
- **GSM8K**: Grade School Math (8.5K problems)
- **AIME 2026**: American Invitational Mathematics Examination
- **HMMT 2026**: Harvard-MIT Mathematics Tournament

### 🧠 Knowledge
- **MMLU-Pro**: Massive Multi-task Language Understanding
- **GPQA Diamond**: PhD-level expert questions
- **HLE**: Humanity's Last Exam

### πŸ’» Coding
- **SWE-bench Verified**: Real-world software engineering tasks
- **SWE-bench Pro**: Advanced software engineering challenges

### πŸ‘οΈ Vision
- **olmOCR**: OCR evaluation benchmark

### πŸ€– Agent
- **Terminal-Bench 2.0**: Terminal command understanding

### πŸ’¬ Language
- **EvasionBench**: Language understanding challenges

## πŸš€ Quick Start

The leaderboard loads automatically from the HuggingFace dataset: `OpenEvals/leaderboard-data`

**Quick Filters:**
- πŸ”Ή **Small (<10B)**, πŸ”Έ **Medium (10-100B)**, πŸ”Ά **Large (100B+)** - Filter by model size
- πŸ’» **Coding**, 🧠 **Knowledge**, πŸ“ **Math**, etc. - Show only specific categories

## πŸ“Š Data Source

**Dataset**: [OpenEvals/leaderboard-data](https://huggingface.co/datasets/OpenEvals/leaderboard-data)

All scores are aggregated from official HuggingFace benchmark leaderboards. The dataset is updated regularly with the latest model evaluations.

## πŸ’» Local Development

```bash
# Install dependencies
pip install -r requirements.txt

# Run the app
python app.py
```

## πŸ“ Project Structure

```
.
β”œβ”€β”€ app.py                    # Main Gradio application
β”œβ”€β”€ utils/
β”‚   β”œβ”€β”€ data_loader.py       # Load data from HuggingFace dataset
β”‚   β”œβ”€β”€ filters.py           # Filter and search logic
β”‚   β”œβ”€β”€ formatters.py        # Data formatting utilities
β”‚   └── html_generator.py    # Generate HTML leaderboard table
β”œβ”€β”€ static/
β”‚   └── sortTable.js         # Client-side table sorting
β”œβ”€β”€ data/
β”‚   └── provider_logos.json  # Provider avatar URLs
└── requirements.txt         # Python dependencies
```

## πŸ”§ Technologies

- **Gradio 5.50.0**: Interactive web interface
- **Datasets**: HuggingFace datasets library
- **Pandas**: Data manipulation
- **RangeSlider**: Custom Gradio component for size filtering

## πŸ“ License

Data is sourced from official HuggingFace benchmarks. Please refer to individual benchmark pages for specific licensing information.

---

Made with ❀️ by the Benchmarks Team