An AI that "forgets" almost everything it sees is actually better at understanding video than the ones with perfect memory.
April 3, 2026
Original Paper
A Simple Baseline for Streaming Video Understanding
arXiv · 2604.02317
The Takeaway
Years of research into building complex AI 'memories' for video may have been focused on the wrong problem. This discovery suggests that current video tests are only measuring short-term patterns rather than true long-term understanding.
From the abstract
Recent streaming video understanding methods increasingly rely on complex memory mechanisms to handle long video streams. We challenge this trend with a simple finding: a sliding-window baseline that feeds only the most recent N frames to an off-the-shelf VLM already matches or surpasses published streaming models. We formalize this baseline as SimpleStream and evaluate it against 13 major offline and online video LLM baselines on OVO-Bench and StreamingBench. Despite its simplicity, SimpleStrea