Lip and Head Gesture Recognition Based Pc Interface Using Image Processing
P. Johnhubert1* and M. S Sheeba2

1Embedded System, Sathyabama University 2Electronics and Communication, Sathyabama University

Abstract: The multimodal human-computer interface (HCI) called Lip Mouse is presented, allowing a user to work on a computer using movements and gestures made with his/her mouth only. Algorithms for lip movement tracking and lip gesture recognition are presented in details. User face images are captured with a standard webcam. Face detection is based on a cascade of boosted classifiers using Haar-like features. A mouth region is located in the lower part of the face region. Its position is used to track lip movements that allows a user to control a screen cursor. Three lip gestures are recognized: mouth opening, sticking out the tongue and forming puckered lips. Lip gesture recognition is performed by various image features of the lip region. An accurate lip shape is obtained by the means of lip image segmentation using lip contour analysis.

Keywords: Matlab; Lip contour; Human computer interface; Image processing

[ HTML Full Text]

Back to TOC