MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering
Changjiang Jiang, Jiang Zhou, Xinbin Yuan, Fan Zhang, Tao Feng, Zhuohan Xie
MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering: 1 upvotes on Hugging Face Daily Papers, #35 of 39 papers on 2026-11-18. Day-by-day upvote history.
Upvotes over time
It had 1 upvotes by the next day, 1 upvotes by day 3, 1 upvotes by day 7, and has 1 now. It ranked #127 of 146 papers in its week and #488 of 520 in its month. Its code repository has 2 GitHub stars.
Multimodal large language models (MLLMs) excel in vision-language tasks; yet, whether they maintain consistent understanding of information-rich visuals (InfoVis) when the surface language changes remains unclear. To quantify this capability, we introduce MInfoVisQA, a parallel benchmark with 8,960 QA configurations derived from 128 seed instances across 24 languages. We construct seed-matched, language-parallel visuals and QA pairs by disentangling numerical-structural data from text and programmatically synchronizing translated labels. We evaluate 25 MLLMs under two settings: Language-Aligned QA (LQA, matching visual-text languages) and Cross-Language QA (XQA, fixed QA language with varying visual languages). The results show that aggregate accuracy masks substantial robustness gaps: two models with comparable mean LQA accuracy (80.4\%) exhibit performance spreads of 7.8 and 20.3 percentage points across languages. Moreover, all 25 models score lower with non-English visuals under fixed English QA, underscoring the need for cross-language sensitivity metrics.
Paper page on Hugging Face · arXiv
Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.