%0 Conference Proceedings
%T Finger Spelling Recognition from Depth data using Direction Cosines and Histogram of Cumulative Magnitudes
%D 2015
%A Cardenas, Edwin Jonathan Escobedo,
%A Chávez, Guillermo Cámara,
%@affiliation Federal University of Ouro Preto
%@affiliation Federal University of Ouro Preto
%E Papa, João Paulo,
%E Sander, Pedro Vieira,
%E Marroquim, Ricardo Guerra,
%E Farrell, Ryan,
%B Conference on Graphics, Patterns and Images, 28 (SIBGRAPI)
%C Salvador
%8 Aug. 26-29, 2015
%I IEEE Computer Society
%J Los Alamitos
%S Proceedings
%K Finger spelling recognition, depth information, points cloud, directional cosines, support vector machine (SVM).
%X In this paper, we propose a new approach for finger spelling recognition using depth information captured by Kinect sensor. We only use depth information to characterize hand configurations corresponding to alphabet letters. First, we use depth data to generate a binary hand mask which is used to segment the hand area from background. Then, the major hand axis is determined and aligned with Y axis in order to achieve rotation invariance. Later, we convert the depth data in a 3D point cloud. The point cloud is divided into subregions and in each one, using direction cosines, we calculated three histograms of cumulative magnitudes Hx, Hy and Hz corresponding to each axis. Finally, these histograms were concatenated and used as input to our Support Vector Machine (SVM) classifier. The performance of this approach is quantitatively and qualitatively evaluated on a dataset of real images of American Sign Language (ASL) hand shapes. The dataset used is composed of 60000 depth images. According to our experiments, our approach has an accuracy rate of 99.37%, outperforming other state-of-the-art methods.
%@language en
%3 PID3771875.pdf