Microsoft Research releases Image Autocomplete support for Video

A few years ago, Microsoft Research’s Computation Photography Group launched its free Image Composite Editor (ICE), a tool for stitching together panorama photos and creating gigapixel images. Now with the support for video the tool can become usefull for creating 360 panoramas.

Finished panoramas can be shared with friends and viewed in 3D by uploading them to the Photosynth web site. Panoramas can also be saved in a wide variety of image formats, including JPEG, TIFF, and Photoshop’s PSD/PSB format, as well as the multiresolution tiled format used by HD View and Deep Zoom.

auto01A

auto01B

3D Printed 360 3D Camera Rig model

Its here! I’m releasing it to the public so more people can try out the rig and see te results.

 

lXk9H0p

 

Project is currently documented on http://360cameraonline.com/

360 video currently is a hard thing to pull of and requires investing in multiple cameras. This concept saves a lot of money considering its using mobius camera instead of expensive GoPro’s (most 360 3D printed rigs are based on GoPro).

3D Printing a camera rig saves a lot of time, and its super hard to manually make this rig so that each lens is exactly at a 51 degree. The rig enables to shoot panoramic 360 3D footage. Lenses are rotated horizontaly for greater field of view.

Based on Jim Watters design 
Prints fine on a standard 20mm x 20mm build plate.

Instructions

Print stil files.
Buy 14 cheap mobius cameras with wide Lens B + 14 exenstion cables for lens seperation the body of the cameras are out of the way – more compact camera
Put everything together
Add one or two GoPro for top view strap with rubber bands
Figure out a way to start recording all at the same time or use Mobius continuous recording. After 5 minutes of run time all the footage should be in sync. If anyone has an idea how to do this by arduino or any other way let me know!
Enjoy! 🙂

Read more about syncing the cameras using arduino experiments.

kMOT3D2

top_bottomview

UxmBEO7

360_camera_3dmodel

 

Download model from Thingiverse

More canvas to play with – 360 Degree Filmmaking for VR


Filmed @ Oculus Connect 2014. A must watch for anyone thinking about creating 360 video content. The panel speaks about creating 360 video that is compelling ot the viewer. What is narrative storytelling and how to do it in 360? Should it be a floating ghost? Is the audience a by stander or do you become a characted in the story? Learn more about this type of filmmaking.

Carmack (Oculus CTO) talks about 360 video challanges.

360 video Samsung Gear VR
John Carmack holds a Samsung Gear VR Headset

“People that are resolution-picky will probably prefer monoscopic videos, which can have twice the resolution of stereo videos. The stereo effect may not be worth anything to you if you can’t get past the blurring.

Here are some notes about video quality that I circulated internally at Oculus:
The hardware decoder on the Samsung devices can handle a lot of bit rate; I think we have successfully played back up to 80 Mb/s, but the largest image stream it can decode is 4096×2048 at 30 fps. For a monoscopic panorama that is roughly the resolution that we render synthetic game content at (but game content is 60 fps), but less than half the optimal resolution for display on the 2560×1440 displays.
There are two limits in play here — the Google video framework in Android has an (arbitrary, as for as I can tell) limit of 2048 lines high on an image, and the decoding hardware has a limit of about 240 Mpixels/s which can be flexibly divided between image size and frame rate. The optimal video stream for the current hardware would be about 6000×3000 at 60 fps in stereo, or 2160 Mpixels/s. A factor of nine over what we have now. When we get 4k displays, that will double again.

The videos we play back now are, in my opinion, “good enough”, but it is clearly still a point that is arguable. One of the super-picky and critical artists we work with kept telling me that our 4k x 2k panoramic photos just didn’t look good, but when I developed the “overlay plane” technology that allowed us to directly sample 1536×1536 cube maps (roughly equal to 6000×3000 equirectangular panoramas) without double-distorting for VR, he finally said “Yeah, that looks good”. He still hates the quality on our panoramic videos. All of the still images in the 360 photos VR app are processed for this resolution, but they don’t necessarily have an optimal content pipeline and compression settings for peak quality.
I want to be able to demonstrate video at this peak quality level, and I think it is going to be important in the coming years, but it isn’t clear what the user experience would be for acquiring and viewing these massive datasets, so this is not the priority of the day.”

 

source: reddit

360 videos and camera build log. Oculus Rift, Samsung Gear VR 3D stereoscopic development