A hybrid neural network/rule-based technique for on-line gesture and hand-written character recognition

Craven, Michael P. and Curtis, K. Mervyn and Hayes-Gill, Barrie H. and Thursfield, C.D. (1997) A hybrid neural network/rule-based technique for on-line gesture and hand-written character recognition. In: Proceedings of the Fourth IEEE International Conference on Electronics, Circuits and Systems, 15-18 December 1997, Cairo, Egypt.

[img] PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (48kB)


A technique is presented which combines rule-based and neural network pattern recognition methods in an integrated system in order to perform learning and recognition of hand-written characters and gestures in realtime.

The GesRec system is introduced which provides a framework for data acquisition, training, recognition, and gesture-to-speech transcription in a Windows environment.

A recognition accuracy of 92.5% was obtained for the hybrid system, compared to 89.6% for the neural network only and 82.7% for rules only. Training and recognition times are given for an able-bodied and a disabled user.

Item Type: Conference or Workshop Item (Paper)
Additional Information: © 1997 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Keywords: gesture recognition, dissimilarity, similarity, segmentation, text-to-speech, gesture-to-speech, sign language, 3D tracking, Augmentative and Alternative Communication, AAC, human computer interaction, HCI
Schools/Departments: University of Nottingham UK Campus > Faculty of Engineering > Department of Electrical and Electronic Engineering
Depositing User: Craven, Dr. Michael P.
Date Deposited: 20 Feb 2013 15:58
Last Modified: 13 Sep 2016 16:29
URI: http://eprints.nottingham.ac.uk/id/eprint/1902

Actions (Archive Staff Only)

Edit View Edit View