Have you every attempted to take a photo or video through glass? What about shooting through a fence or a tree branch? These common obstructions can easily ruin our footage but this new software can completely clean the scenes with just a few reference frames.
This video accompanied a paper titled "A Computational Approach For Obstruction-Free Photography." The creators write:
We present a unified computational approach for taking photos through reflecting or occluding elements such as windows and fences. Rather than capturing a single image, we instruct the user to take a short image sequence while slightly moving the camera. Differences that often exist in the relative position of the background and the obstructing elements from the camera allow us to separate them based on their motions, and to recover the desired background scene as if the visual obstructions were not there. We show results on controlled experiments and many real and practical scenarios, including shooting through reflections, fences, and raindrop-covered windows.
I'm excited to see this technology built into our photos and video editing software in the near future. It's certainly not perfect but it it's an incredible start to something that will certainly be taken for granted one day soon.