L. Sigal

Publications (2)0 Total impact

• Conference Proceeding: 3D hand pose reconstruction using specialized mappings

  R. Rosales, V. Athitsos, L. Sigal, S. Sclaroff
  [show abstract] [hide abstract]
  ABSTRACT: A system for recovering 3D hand pose from monocular color sequences is proposed. The system employs a non-linear supervised learning framework, the specialized mappings architecture (SMA), to map image features to likely 3D hand poses. The SMA's fundamental components are a set of specialized forward mapping functions, and a single feedback matching function. The forward functions are estimated directly from training data, which in our case are examples of hand joint configurations and their corresponding visual features. The joint angle data in the training set is obtained via a CyberGlove, a glove with 22 sensors that monitor the angular motions of the palm and fingers. In training, the visual features are generated using a computer graphics module that renders the hand from arbitrary viewpoints given the 22 joint angles. The viewpoint is encoded by two real values, therefore 24 real values represent a hand pose. We test our system both on synthetic sequences and on sequences taken with a color camera. The system automatically detects and tracks both bands of the user, calculates the appropriate features, and estimates the 3D hand joint angles and viewpoint from those features. Results are encouraging given the complexity of the task
  Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on; 02/2001
• Conference Proceeding: Estimation and prediction of evolving color distributions for skinsegmentation under varying illumination

  L. Sigal, S. Sclaroff, V. Athitsos
  [show abstract] [hide abstract]
  ABSTRACT: A model approach for real time skin segmentation in video sequences is described. The approach enables reliable skin segmentation despite wide variation in illumination during tracking. An explicit second order Markov model is used to predict evolution of the skin color (HSV) histogram over time. Histograms are dynamically updated based on feedback from the current segmentation and based on predictions of the Markov model. The evolution of the skin color distribution at each frame is parameterized by translation, scaling and rotation in color space. Consequent changes in geometric parameterization of the distribution are propagated by warping and re-sampling the histogram. The parameters of the discrete time dynamic Markov model are estimated using maximum likelihood estimation, and also evolve over time. Quantitative evaluation of the method was conducted on labeled ground-truth video sequences taken from popular movies
  Computer Vision and Pattern Recognition, 2000. Proceedings. IEEE Conference on; 02/2000