Accurate Human Body Reconstruction for Volumetric Video
Abstract
In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using traditional stereo matching techniques, we introduce and optimize deep learning-based multi-view stereo networks for depth map estimation in the context of professional volumetric video reconstruction. Furthermore, we propose a novel depth map post-processing approach including filtering and fusion, by taking into account photometric confidence, cross-view geometric consistency, foreground masks as well as camera viewing frustums. We show that our method can generate high levels of geometric detail for reconstructed human bodies.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2022
- DOI:
- 10.48550/arXiv.2202.13118
- arXiv:
- arXiv:2202.13118
- Bibcode:
- 2022arXiv220213118C
- Keywords:
-
- Computer Science - Computer Vision and Pattern Recognition
- E-Print:
- 2021 International Conference on 3D Immersion (IC3D)