A multiple camera system with real-time volume reconstruction for articulated skeleton pose tracking. (English)
Lee, Kuo-Tien (ed.) et al., Advances in multimedia modeling. 17th international multimedia modeling conference, MMM 2011, Taipei, Taiwan, January 5‒7, 2011. Proceedings, Part I. Berlin: Springer (ISBN 978-3-642-17831-3/pbk). Lecture Notes in Computer Science 6523, 182-192 (2011).
Summary: We present a multi-camera system for recovering skeleton body pose, by performing real-time volume reconstruction and using a hierarchical stochastic pose search algorithm. Different from many multi-camera systems that require a few connected workstations, our system only uses a signle PC to control 8 cameras for synchronous image acquisition. Silhouettes of the 8 cameras are extracted via a color-based background subtraction algorithm, and set as input to the 3D volume reconstruction. Our system can perform real-time volume reconstruction rendered in point clouds, voxels as well as voxels with texturing. The full-body skeleton pose (29-D vector) is then recovered by fitting an articulated body model to the volume sequences. The pose estimation is performed in a hierarchical manner, by using a particle swarm optmization (PSO) based search strategy combined with soft constraints. 3D distance transform (DT) is used for reducing the computing time of objective evaluations.