3D Motion Magnification: Visualizing Subtle Motions with Time Varying Radiance Fields

Brandon Feng, Hadi Alzayer, Michael Rubinstein, William T. Freeman, Jiabin Huang

3D Motion Magnification: Visualizing Subtle Motions with Time Varying Radiance Fields: 13 upvotes on Hugging Face Daily Papers, #9 of 16 papers on 2023-08-08. Day-by-day upvote history.

Motion magnification helps us visualize subtle, imperceptible motion. However, prior methods only work for 2D videos captured with a fixed camera. We present a 3D motion magnification method that can magnify subtle motions from scenes captured by a moving camera, while supporting novel view rendering. We represent the scene with time-varying radiance fields and leverage the Eulerian principle for motion magnification to extract and amplify the variation of the embedding of a fixed point over time. We study and validate our proposed principle for 3D motion magnification using both implicit and tri-plane-based radiance fields as our underlying 3D scene representation. We evaluate the effectiveness of our method on both synthetic and real-world scenes captured under various camera setups.

Paper page on Hugging Face · arXiv

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.