Joint Example-Based Depth Map Super-Resolution

The fast development of Time-of-Flight (ToF) cameras in recent years enables capture of high frame-rate 3D depth maps of moving objects. However, the resolution of depth map captured by ToF is rather limited, and thus it cannot be directly used to build a high quality 3D model. In order to handle this problem, the authors propose a novel joint example-based depth map super-resolution method, which converts a low resolution depth map to a high resolution depth map, using a registered high resolution color image as a reference. Different from previous depth map SR methods without training stage, they learn a mapping function from a set of training samples and enhance the resolution of the depth map via sparse coding algorithm.