Introducing Evaluation Cards: A Live Interpretive Layer for Understanding the AI Evaluations Ecosystem
• 1
AI & ML interests
We’re building a research coalition on evaluating evaluations (EvalEval)! Hosted by Hugging Face, University of Edinburgh, and EleutherAI.
Recent Activity
View all activity
Articles
evijit
updated a
bucket about 1 hour ago
j-chim
updated a
bucket about 12 hours ago
j-chim
updated a
dataset about 14 hours ago
[Submission] Add Kaggle Community Benchmarks results
2
#157 opened about 17 hours ago
by 
mrshu
[Submission] Add Kaggle Community Benchmarks results
2
#157 opened about 17 hours ago
by mrshu
[Submission] Add Kaggle Community Benchmarks results (1/14)
1
#158 opened about 17 hours ago
by mrshu
[Submission] Add Kaggle Community Benchmarks results (1/14)
1
#158 opened about 17 hours ago
by mrshu
evijit
updated a
dataset about 18 hours ago
j-chim
authored 8
papers 2 days ago
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Paper • 2303.03915 • Published • 8
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Paper • 2206.11249 • Published
BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing
Paper • 2206.15076 • Published • 5
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Paper • 2211.05100 • Published • 39
All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
Paper • 2411.16508 • Published • 10
INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge
Paper • 2411.19799 • Published • 17
Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations
Paper • 2511.05613 • Published
Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
Paper • 2606.09809 • Published • 4
felfri
authored 3
papers 5 days ago
LLMs Gaming Verifiers: RLVR can Lead to Reward Hacking
Paper • 2604.15149 • Published • 1
Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
Paper • 2606.09809 • Published • 4
The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL
Paper • 2606.19162 • Published • 20
EvalEvalBot
updated a
dataset 6 days ago