Automatic reconstruction of 3D human motion pose from uncalibrated monocular video sequences based on markerless human motion tracking

School of Information Science and Engineering, Central South University, Changsha 410083, People's Republic of China
Pattern Recognition (Impact Factor: 3.1). 07/2009; 42(7):1559-1571. DOI: 10.1016/j.patcog.2008.12.024
Source: DBLP


We present a method to reconstruct human motion pose from uncalibrated monocular video sequences based on the morphing appearance model matching. The human pose estimation is made by integrated human joint tracking with pose reconstruction in depth-first order. Firstly, the Euler angles of joint are estimated by inverse kinematics based on human skeleton constrain. Then, the coordinates of pixels in the body segments in the scene are determined by forward kinematics, by projecting these pixels in the scene onto the image plane under the assumption of perspective projection to obtain the region of morphing appearance model in the image. Finally, the human motion pose can be reconstructed by histogram matching. The experimental results show that this method can obtain favorable reconstruction results on a number of complex human motion sequences.

1 Follower
36 Reads
  • Source
    • "Studying how humans move and interact with their environment is an important part of Pervasive Health, AmI and Ubiquitous applications, like the telerehabilitation [2]. Thus, many efforts are being put to analyze human motion using different means (inertial sensors [3,4], camera-surveilled environments [5], a combination of both vision and inertial sensing [6], or robots following persons [7]). Monitoring human motion using cameras has shown to be very effective in representing motion characteristics, but presents issues with privacy and limitation of its application to closed spaces. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Determination of (in)activity periods when monitoring human body motion is a mandatory preprocessing step in all human inertial navigation and position analysis applications. Distinction of (in)activity needs to be established in order to allow the system to recompute the calibration parameters of the inertial sensors as well as the Zero Velocity Updates (ZUPT) of inertial navigation. The periodical recomputation of these parameters allows the application to maintain a constant degree of precision. This work presents a comparative study among different well known inertial magnitude-based detectors and proposes a new approach by applying spectrum-based detectors and memory-based detectors. A robust statistical comparison is carried out by the use of an accelerometer and angular rate signal synthesizer that mimics the output of accelerometers and gyroscopes when subjects are performing basic activities of daily life. Theoretical results are verified by testing the algorithms over signals gathered using an Inertial Measurement Unit (IMU). Detection accuracy rates of up to 97% are achieved.
    Sensors 12/2012; 12(5):5791-814. DOI:10.3390/s120505791 · 2.25 Impact Factor
  • Source
    • "Based on the type of footage used, the markerless pose reconstruction (or motion capture) problem can be roughly categorized into two groups [24]: using video sequences from one camera or using footage from multiple calibrated cameras. Pose estimation from monocular video sequences [2], [3], [24], [17], [1], [18] can be more convenient for some applications as it imposes less restrictions to the user, but it has an inherent depth ambiguity. This ambiguity can be solved using structure from motion approaches, a very difficult problem in vision [13], [14]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: We propose a data-driven, multi-view body pose estimation algorithm for video. It can operate in uncontrolled environments with loosely calibrated and low resolution cameras and without restricting assumptions on the family of possible poses or motions. Our algorithm first estimates a rough pose estimation using a spatial and temporal silhouette based search in a database of known poses. The estimated pose is improved in a novel pose consistency step acting locally on single frames and globally over the entire sequence. Finally, the resulting pose estimation is refined in a spatial and temporal pose optimization consisting of novel constraints to obtain an accurate pose. Our method proved to perform well on low resolution video footage from real broadcast of soccer games.
    International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011, Hangzhou, China, 16-19 May 2011; 01/2011
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In wireless body sensor networks, sensors may be installed on various body limbs to wirelessly collect body information for homecare services. The orientations and accel-erations on each limb are different for various motion states. For example, each limb has different acceleration when walking versus running, and orientation when standing versus lying. According to the above information, the body motion state may be decided. Furthermore, each person has unique body characteristics such as height, foot pitch, and motion habit to effect the body reconstruction. Therefore, it is a challenging issue how to present human motions through 3D skeleton system simulation, and achieve an adaptive reconstruction of human motion according to the different body characteristics of each person. In this study, we proposed a novel scheme to utilize multiple triple axis accelerometer and gyroscopes to measure limb accelerations, then calculated the locations of limbs and try to employ kinematic theory to reconstruct human body skeleton, called 3D Adaptive human Motion Reconstruction (AMR). And we applied Body Correction Algorithm (BCA) to correct human body characteristics and fighted the error of transmission noise. This system was tested and validated with success.
Show more

Similar Publications