We’re sharing how we’ve enabled Dolby Vision and ambient viewing environment (amve) on the Instagram iOS app to enhance the video viewing experience. HDR videos created on iPhones contain unique Do…
Overview
The article discusses the integration of Dolby Vision and ambient viewing environment (amve) into the Instagram iOS app to enhance HDR video playback. It outlines the challenges faced during implementation, the processing stages of video at Meta, and the results of A/B testing that led to improved user engagement.
What You'll Learn
1
How to implement Dolby Vision metadata in video encoding
2
Why preserving amve metadata is crucial for HDR video quality
3
How to conduct A/B testing for video features in mobile apps
Prerequisites & Requirements
- Understanding of HDR video encoding and metadata
- Familiarity with FFmpeg and video processing tools(optional)
Key Questions Answered
What is Dolby Vision and how does it enhance video playback?
Dolby Vision is a technology that enhances color, brightness, and contrast in videos to match the capabilities of the display. It uses specific metadata to ensure that HDR content is rendered accurately across different devices and viewing conditions, providing a superior viewing experience.
How does Meta process videos uploaded to Instagram?
Meta processes videos through three main stages: Client Processing, where the video is encoded with metadata; Server Processing, where different versions for various devices are generated; and Consumption, where the viewer's device selects and plays the optimal video version.
What challenges did Meta face when enabling Dolby Vision?
Meta faced challenges in delivering Dolby Vision metadata within non-HEVC formats and ensuring compatibility with AVSampleBufferDisplayLayer. They had to implement support for Dolby Vision Profiles 8 and 10 in their video processing tools, which required collaboration with FFmpeg developers.
What were the results of the A/B tests conducted on Dolby Vision metadata?
Initial A/B tests showed that videos with Dolby Vision metadata were watched less due to longer load times caused by increased metadata size. After optimizing the metadata format, subsequent tests indicated increased viewer engagement, leading to the decision to implement Dolby Vision across Instagram for iOS.
Key Statistics & Figures
Metadata overhead increase
100 kbps
This increase in metadata size was identified as a reason for longer load times during initial A/B tests.
Reduced metadata overhead after optimization
25 kbps
The new compressed metadata format significantly reduced the overhead, improving load times and user engagement.
Technologies & Tools
Video Processing
Ffmpeg
Used for encoding and transcoding videos, including support for Dolby Vision metadata.
Video Codec
Av1
Used for delivering high-quality video with Dolby Vision metadata.
Video Codec
Hevc
Original codec used for iPhone-produced HDR videos before transcoding.
Key Actionable Insights
1Implementing Dolby Vision metadata can significantly enhance video quality on supported devices, making it essential for apps focused on visual content.This is particularly important for platforms like Instagram, where user engagement is closely tied to video quality. Ensuring that metadata is preserved during encoding can lead to better user experiences.
2Conducting A/B tests on new features allows for data-driven decisions that can improve user engagement.By comparing user interactions with different video versions, Meta was able to identify issues with load times and optimize the experience, demonstrating the importance of testing in app development.
3Understanding the lifecycle of video processing at Meta can inform better practices in video app development.Familiarity with client, server, and consumption stages can help developers optimize their own video processing workflows and ensure compatibility with various devices.
Common Pitfalls
1
Failing to preserve important metadata during video processing can lead to suboptimal viewing experiences.
This issue was initially encountered by Meta, where HDR videos lacked Dolby Vision and amve metadata, resulting in poor representation of video quality across devices.
2
Assuming that static metadata values will remain unchanged across different devices can lead to inaccuracies.
Meta's initial hardcoding of amve values was a temporary fix that could have caused issues with future iPhone models or iOS updates.
Related Concepts
Hdr Video Encoding
Dolby Vision Technology
A/B Testing In Mobile Applications
Video Processing Workflows