MV-HEVC: How to Optimize Compression of Immersive 3D Content

Broadcast Engineering and IT Conference , Core Education Collection , Core Education Collection: Connect Series

Originally Aired - Sunday, April 14 | 3:20 PM - 3:40 PM PT

W220-W221

Pass Required: Core Education Collection Pass

Don't have this pass? Register Now!

Create or Log in to myNAB Show to see Videos and Resources.

Videos Resources

Videos

Resources

Click to Join the Zoom Meeting

{{resource.title}}

Resources

{{resource.title}}

This Session Has Not Started Yet

Be sure to come back after the session starts to have access to session resources.

Multi-view High Efficiency Video Coding (MV-HEVC) is an HEVC extension focused on efficiently coding spatially related images, such as a left eye and right eye views of 3D stereoscopic contents. MV-HEVC was released in the second version of HEVC back in October 2014. MV-HEVC was created alongside another extension named SHVC, which is already used in ATSC 3.0 use cases since 2018. The two extensions share many fundamentals, codified in an annex for common specifications for multi-layer extensions. Their base principle is scalability: A traditional HEVC decoder can rely on the base layer only, hence providing backward compatibility, but a more elaborate decoder can use the second layer as well to improve the rendition.

The MV-HEVC format recently gained widespread attention with Apple announcing support for 3D movies on the Apple Vision Pro at WWDC23.

This presentation will describe the MV-HEVC standard and how it works in theory. An overview of Apple guidelines will also be provided. An implementation of MV-HEVC will be studied to assess practical performance in industrial settings. Deployment aspects such as content adaptive encoding, grain management, packaging, DAI and captioning will be discussed. Finally, 3D-specific optimization strategies will be analyzed, including software architecture and rate control, with detailed attention paid on how efficiently distributing bits between two views.