ABSTRACT
Training of multilayered feed-forward neural networks (MLFFNNs) is considered in this work. A procedure to derive high performance learning algorithm for updating the network weights is proposed. The proposed algorithm is based on heuristic technique that is developed from an analysis of the performance of the basic-backpropagation training algorithm. A unified formulation of the conventional learning algorithms including the basic-backpropagation algorithm, the momentum algorithm, and the exponential-smoothing algorithm alongside with the proposed learning algorithm is introduced. Recursive relations for updating the weights of the network are derived which greatly simplifies the application of these rules. Simulation results are presented and comparative studies are carried out to demonstrate the effectiveness of the new learning algorithm. The new algorithm can converge more than hundred times faster than the conventional algorithms.