MemInStream: Memorizing or Merely Recognizing? Rethinking Streaming Video Memory Evaluation
He Zhenqi, Dunyuan Xu, Leo, Kien T. Pham, Yanghao Wang, shuhan, terryguo, He Yuyang, Fang Liu, GuanHuankang, Jingyan Chen, Rui Liu, Long Chen
MemInStream: Memorizing or Merely Recognizing? Rethinking Streaming Video Memory Evaluation: 4 upvotes on Hugging Face Daily Papers, #27 of 40 papers on 2026-11-16. Day-by-day upvote history.
Upvotes over time
It had 1 upvotes by its first day, 2 upvotes by the next day, 4 upvotes by day 3, 4 upvotes by day 7, and has 4 now. It ranked #84 of 146 papers in its week and #361 of 520 in its month. Its code repository has 12 GitHub stars.
Streaming video understanding aims to continuously process incoming visual observations, making the retention and retrieval of relevant information increasingly important as the video history grows. Although existing benchmarks include memory-related questions, question-answering accuracy alone does not reliably measure memory capabilities. Incorrect predictions may arise from failures in visual understanding rather than forgetting, whereas correct predictions may rely on linguistic priors or recent observations without requiring historical memory. To address these ambiguities, we introduce MemInStream, a benchmark dedicated to evaluating memory capabilities in streaming video understanding. We develop an evidence-controlled validation protocol that associates each question with temporally localized evidence intervals. The protocol validates evidence solvability and memory necessity by retaining questions that models can answer from the annotated evidence but cannot resolve using recent observations, post-evidence observations, or textual input alone. This helps disentangle memory limitations from understanding failures while reducing memory-independent shortcuts. MemInStream provides a systematic evaluation of memory capabilities through four major categories, covering Episodic Retrieval, State Tracking \& Updating, Multi-Evidence Integration, and Contextual Memory across diverse video scenarios. Overall, MemInStream provides a comprehensive and reliable benchmark for systematically evaluating memory capabilities in streaming video understanding.
Paper page on Hugging Face · arXiv
Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.