HarnessEval-W: Agentifying the Evaluation of Visual Worlds
Paper • 2608.16859 • Published • 123
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Benchmark Test-Time Scaling of General LLM Agents
On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
VanishD
authored a
paper 7 days ago
Nyandwi
submitted a
paper to Daily Papers 7 days ago
Xuhui
updated a
collection 2 months ago
lwaekfjlk
submitted a
paper to Daily Papers 2 months ago
Xuhui
updated a
collection 3 months ago
Post
131
🚀 VQAScore now supports text-to-video evaluation!
VQAScore scores how well a generated image or video matches a prompt by asking a VLM "does this show {prompt}?" and using P(Yes). It became a go-to evaluation metric and reward model for image generation (2M+ downloads), and we just added text-to-video support across 20+ VLMs (GPT, Gemini, Qwen). Free and open-source, and it keeps improving as VLMs improve.
💻 Code: https://github.com/linzhiqiu/t2v_metrics
📄 Paper: https://arxiv.org/abs/2404.01291
🧵 Launch thread + demo video: https://x.com/ZhiqiuLin/status/2064316582461841499
VQAScore scores how well a generated image or video matches a prompt by asking a VLM "does this show {prompt}?" and using P(Yes). It became a go-to evaluation metric and reward model for image generation (2M+ downloads), and we just added text-to-video support across 20+ VLMs (GPT, Gemini, Qwen). Free and open-source, and it keeps improving as VLMs improve.
💻 Code: https://github.com/linzhiqiu/t2v_metrics
📄 Paper: https://arxiv.org/abs/2404.01291
🧵 Launch thread + demo video: https://x.com/ZhiqiuLin/status/2064316582461841499
- 1 reply
Xuhui
updated 2
datasets 3 months ago
Xuhui
published 2
datasets 3 months ago
dheerajpai
authored a
paper 3 months ago
seungone
authored 2
papers 3 months ago
Xuhui
updated a
collection 3 months ago
Xuhui
updated a
model 3 months ago
Xuhui
published a
model 3 months ago
Xuhui
updated a
model 3 months ago