Introducing Facebook Surround 360: An open, high-quality 3D-360 video capture system

Visit the post for more.

Meta logo
Meta
•12 min read•intermediate•
--
•View Original
HTML

Overview

The article introduces Facebook Surround 360, an open-source, high-quality 3D-360 video capture system designed to enhance the production of virtual reality content. It details the system's hardware and software components, the challenges faced in VR capture, and the innovative stitching algorithms that significantly reduce post-production time.

What You'll Learn

1

How to utilize optical flow algorithms for stitching 3D-360 video

2

Why global synchronization is critical in 3D-360 video capture

3

How to design a durable and reliable 3D-360 video capture rig

Prerequisites & Requirements

  • Understanding of 3D video capture concepts
  • Familiarity with Linux-based systems for camera control(optional)

Key Questions Answered

What are the main components of the Facebook Surround 360 system?
The Facebook Surround 360 system consists of three major components: the hardware (camera and control computer), the camera control software for synchronized capture, and the stitching and rendering software. Each component is interconnected to ensure reliability and quality in video capture.
How does the stitching software improve post-production time?
The stitching software utilizes advanced optical flow algorithms to stitch images together, drastically reducing post-production time from weeks to overnight. This automation allows for seamless stereoscopic 360 panoramas with minimal manual intervention.
What video resolutions does the Surround 360 system support?
The Surround 360 system supports video exports at 4K, 6K, and 8K resolutions for each eye. The 8K output is particularly notable as it doubles the industry standard, enhancing the viewing experience on devices like Gear VR.
What challenges does the Surround 360 system address in VR capture?
The Surround 360 system addresses challenges such as overheating cameras, unreliable rigs, and lengthy manual stitching processes. It aims to provide a reliable, professional-grade solution for capturing high-quality 3D-360 video.

Key Statistics & Figures

Video output resolution
4K, 6K, and 8K per eye
The system's 8K output doubles the industry standard, allowing for enhanced viewing experiences on VR devices.
Post-production time reduction
From weeks to overnight
The stitching software automates processes that traditionally required extensive manual effort.
Sustained transfer rate for camera capture
17 Gb/s
This rate is necessary to handle the isochronous nature of the camera capture at 30 Hz.

Technologies & Tools

Operating System
Linux
Used for camera control and data movement to support live video stream transfers.
Storage
SSD
An 8-way level-5 RAID SSD disk system is utilized to manage high data transfer rates required for video capture.

Key Actionable Insights

1
Leverage the open-source nature of the Surround 360 system to innovate in VR content creation.
By accessing the designs and software available on GitHub, developers can modify and enhance the 3D-360 video capture technology, fostering a collaborative environment for innovation.
2
Implement global synchronization in your camera setups to ensure high-quality stitching.
Achieving synchronization within 1 ms is crucial for seamless stitching of 3D-360 video. This practice can significantly improve the quality of the final output.
3
Utilize the optical flow algorithm for improved image stitching results.
Optical flow algorithms provide a mathematically rigorous approach to compute stereo disparity, enhancing the quality of 3D-360 panoramas and reducing manual intervention.

Common Pitfalls

1
Failing to achieve global synchronization can lead to stitching issues.
Without synchronization, frames captured by different cameras may not align properly, resulting in poor-quality stitching and a disjointed final video.
2
Overheating cameras during extended shoots can compromise reliability.
Cameras must be designed to operate without overheating for long periods, as overheating can lead to failures and impact the overall quality of the video capture.

Related Concepts

3d Video Capture Techniques
Optical Flow Algorithms
Virtual Reality Content Production