Dynamic hand gesture recognition using RGB-D data
What is it about?
Hand gesture recognition is widely used in human-computer interaction (HCI) and has attracted substantial researching attentions.We have developed a low-complexity and real-time solution of dynamic hand gestures recognition using RGB-D depth sensor for natural human-computer interaction applications.
Why is it important?
We combine Euclidean distance between hand joints and shoulder center joint with the modulus ratios of skeleton features to generate a unifying feature descriptor for each dynamic hand gesture. And then, an improved dynamic time warping (IDTW) algorithm is proposed to obtain the final recognition results, which applies the weighted distance and a restricted search path to avoid the huge computation in conventional DTW and improves the cognition performance. Experimental results show that the proposed algorithm of dynamic hand gesture recognition not only achieves higher average recognition rate of 96.5% and better performance in response time, but also is robust to uncontrolled environments. Finally, according to our hand gesture recognition solutions, we develop one real-life HCI applications to control a virtual coalmine environment, which operates accurately and efficiently.