HuskyDoge
  • About
  • Research
  • Blogs
  • Misc
Xiaohongshu

#Benchmark

Research

ACL 2025 Findings
Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation
Qiyue Gao, Xinyu Pi, Kevin Liu, Junrong Chen, Ruolan Yang, Xinqi Huang, Xinyu Fang, Lu Sun, Gautham Kishore, Bo Ai, Stone Tao, Mengyang Liu, Jiaxi Yang, Chao-Jung Lai, Chuanyang Jin, Jiannan Xiang, Benhao Huang, Zeming Chen, David Danks, Hao Su, Tianming Shu, Ziqiao Ma, Lianhui Qin, Zhiting Hu
Jun 1st 2025
World Models Workshop @ ICLR 2025
#World Model
#Benchmark

This paper evaluates whether modern Vision-Language Models (VLMs) like GPT-4o and Gemini can act as internal world models (WMs)—systems that understand and predict the world.

paper
🤗HuggingFace
website
Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation
KDD 2025
DCA-Bench: A Benchmark for Dataset Curation Agents
Benhao Huang, Yingzhuo Yu, Jin Huang, Xingjian Zhang, Jiaqi W. Ma
May 1st 2025
Data World Workshop @ ICML 2025
#LLM Agent
#Benchmark
#Data-centric AI

A benchmark exploring the performance of LLM Agents on detecting issues in datasets hosted on popular platforms.

paper
Github
🤗HuggingFace
slides
poster
DCA-Bench: A Benchmark for Dataset Curation Agents