Render2MPEG: A Perception-based Framework Towards Integrating Rendering and Video Compression

Currently 3D animation rendering and video compression are completely independent processes even if rendered frames are streamed on-the-fly within a client-server platform. In such scenario, which may involve time-varying transmission bandwidths and different display characteristics at the client side, dynamic adjustment of the rendering quality to such requirements can lead to a better use of server resources. In this work, we present a framework where the renderer and MPEG codec are coupled through a straightforward interface that provides precise motion vectors from the rendering side to the codec and perceptual error thresholds for each pixel in the opposite direction. The perceptual error thresholds take into account bandwidth-dependent quantization errors resulting from the lossy compression as well as image content-dependent luminance and spatial contrast masking. The availability of the discrete cosine transform (DCT) coefficients at the codec side enables to use advanced mode...

• Type: Journal
• Year: 2008
• Where: CGF
• Authors: Robert Herzog, Shin-ichi Kinuwaki, Karol Myszkowski, Hans-Peter Seidel
• Keywords: CGF 2008, Codec, Perceptual Error, Perceptual Error Threshold