Simultaneous Tracking of Both Hands by Estimation of Erroneous Observations

Thearticulate motionof thehandmakesit very difficult to track thehands while performing a gesture.Simultaneoustrackingof both hands needsto dealwith largeinterframevariationsin shape,clutterandmutual occlusion. In this paper , we presenta robustmethodfor localizing thehandregion by tracking even in the presence of severe occlusion.We develop a model for tracking two rectangularwindows,eachboundingoneof thehands,usingthe condensationalgorithm. We proposea new methodfor dealingwith occlusionsby estimatingtheoccludedobservations in termsof thenon-occluded obser vationsandtheirpredictedvalues,yielding very reliableresults.