A faster learning neural network classifier using selective backpropagation

Tools

Craven, Michael P. (1997) A faster learning neural network classifier using selective backpropagation. In: Fourth IEEE International Conference on Electronics, Circuits and Systems, 15-18 December 1997, Cairo, Egypt.

Full text not available from this repository.

Abstract

The problem of saturation in neural network classification problems is discussed. The listprop algorithm is presented which reduces saturation and dramatically increases the rate of convergence.

The technique uses selective application of the backpropagation algorithm, such that training is only carried out for patterns which have not yet been learnt to a desired output activation tolerance. Furthermore, in the output layer, training is only carried out for weights connected to those output neurons in the output vector which are still in error, which further reduces neuron saturation and learning time.

Results are presented for a 196-100-46 Multi-Layer Perceptron (MLP) neural network used for text-to-speech conversion, which show that convergence is achieved for up to 99.7% of the training set compared to at best 94.8% for standard backpropagation. Convergence is achieved in 38% of the time taken by the standard algorithm.

Item Type: Conference or Workshop Item (Paper)
RIS ID: https://nottingham-repository.worktribe.com/output/1024324
Additional Information: © 1997 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Keywords: neural networks, ANN, satuation, convergence, backpropagation, backprop, text-to-speech, classification, classifier
Schools/Departments: University of Nottingham, UK > Faculty of Engineering
Depositing User: Craven, Dr. Michael P.
Date Deposited: 20 Feb 2013 15:55
Last Modified: 04 May 2020 20:33
URI: https://eprints.nottingham.ac.uk/id/eprint/1901

Actions (Archive Staff Only)

Edit View Edit View