Due to the popularity of action cams like the GoPro, POV shots have lost on their attractiveness – especially that an uncut shot may be overly long, while a cut one may not give sufficient info about the environment, etc. The simplest of solution is to speed up the footage to fly through the less entertaining part of the shot, yet still preserving it. The problem is that simply speeding up the footage will result in a flickering, tiresome and unattractive image. The solution has been presented by Microsoft with their (unreleased yet) software.
At research.microsoft.com we read that Hyperlapse de-shakes the footage in the following steps:
- Scene Reconstruction: Our algorithm first reconstructs the 3D input camera path as well as dense, per-frame proxy geometries. We then optimize a novel camera path for the output video (shown in red) that is smooth and passes near the input cameras while ensuring that the virtual camera looks in directions that can be rendered well from the input.
- Proxy Geometry: Next, we compute geometric proxies for each input frame. These allow us to render the frames from the novel viewpoints on the optimized path.
- Stich & blend: Finally, we generate the novel smoothed, time-lapse video by rendering, stitching, and blending appropriately selected source frames for each output frame. We present a number of results for challenging videos that cannot be processed using traditional techniques.
Here a video comparing hyperlapse video with and without the application of the new software:
Since it comes from Microsoft, it will be developed as a Windows app. But as the idea and the tech is available, there’s nothing that prevents a Mac version from being released as well. We’re waiting for this one impatiently. Full coverage can be found at research.microsoft.com by following this link.