Microsoft Hyperlapse Project Aims to Make First-Person Videos Enjoyable at Last

First-person cameras, such as the ubiquitous GoPro, have been filming hours of footage from their owner’s journeys for years now. These lengthy uncut videos don’t hold much interest to most people, but a team of Microsoft Researchers are aiming to change that by using some remarkable technology they hope to release as part of an upcoming app.

Project researchers Johannes Kopf, Michael Cohen and Richard Szeliski have come up with a method to take boorishly long first-person camera footage and convert it in to hyperlapse video. The hyperlapse movies are timelapsed at 10X speed while camera shakes are smoothened beyond the capabilities of current stabilization techniques.

In order to achieve the smooth flowing motion from rough first-person footage, the software reconstructs the camera’s path on to a depth map. Then, algorithms are used to find an optimized path that the footage should be rendered in to. In order to fill in the pieces that were never captured on camera, the program will stitch, blend, and render the missing surroundings. For challenging videos, the software will create a number of options to choose from.

First-Person Hyperlapse Path Planning Map

For a more in-depth look at what exactly is going on, the team also have a technical paper you can read off the project website and this detailed video to check out:

[via TechCrunch]

Log in or register to post comments

11 Comments

Wow this one is really interesting ....

some really talented coders. Looks very slick. Actually far less glitches then I'd expect.

Ryan Mense's picture

I meant to have it linked. Thanks for the heads up.

Pretty cool! But dosnt seem like it's suited for the mountain environment, giving a bit of a google maps effect to the environment

Greg Tennyson's picture

Hey Gopro! This would be nice to have in your software...

Adam Ottke's picture

This is amazing. It finally makes it worth it to actually wear a camera for a day. All of a sudden, my mind is spinning with possibilities and new ways to tell stories... I'm sure you can do this with a million-dollar production budget. But this way...man...this could be really neat...

Take my money now.

Mo Pla's picture

this is f***** awesome. People are awesome who got the idea to do this and have done and accomplished this.

Dylan Patrick's picture

Some very exciting tech for sure

Spy Black's picture

Well, this is cool, but is it going to be software you can use on your home machine, or are you going to have to upload it somewhere to get processed? That would be problematic with terabytes of video.