Lytro's Immerge System Could Capture the Most Convincing VR Video Yet

By Mario Aguilar on at

Lytro has had a rough ride since introducing the world to its very cool light field capture technology just over four years ago in 2011. Following a few consumer camera flops, the company’s rolling on to the pros. Immerge is perhaps the most sophisticated virtual reality camera yet.

In short, Immerge is a large 360-degree camera rig which uses Lytro’s light-field tech to capture video for virtual reality headsets, like the Oculus Rift. Lytro’s not the first company to develop a system for capturing 360-video. Google teamed up with GoPro to develop a relatively simple rig. Startups like Jaunt have their own proprietary solutions. And production companies have developed all manner of solutions for shooting everything from 360 commercials to very immersive porn.

All the existing capture systems have their drawbacks owing to the fact that they use many traditional video cameras and then stitch together 2D videos into a 360 image. It’s a neat trick, but it’s not totally convincing.

Lytro thinks that it can leverage its tech to capture a computationally perfect 360 image. Shall we recap? Four years ago, Lytro introduced its sophisticated light field tech, which captured a reading of all of the light in a scene and then allowed you to focus after the fact. It's really clever stuff, but implementing it in a consumer camera is expensive and really not that interesting to regular people. Applied to a problem like 360 video, however, Lytro thinks it might have some legs.

Lytro's Immerge System Could Capture the Most Convincing VR Video Yet

The core of Immerge is of course a camera. Immerge takes the existing VR camera concepts and multiplies them to the extreme. Immerge creates a sphere with hundreds of cameras distributed over several rings which will shoot capture light field at a high frame rate. (Lytro’s still finalising the exact specifications.) Remember, this camera is capturing a picture of the light in the scene, not the scene itself, which means the resulting videos will be endlessly immersive. When you move your head, Lytro’s computational tech will figure out exactly what you should see. It’ll be, well, realistic. In theory anyway.

This system will chew up tons of data, for which Lytro has developed a special server. As a plus, Lytro says it plans to make editing tools that work with the software editors already use.

There’s no price for the system yet but it will be astronomical regardless. But Lytro envisions Immerge for professionals anyway, and they’re more likely to rent the system when they need it.