Paper
2 September 1993 Studies on some properties of a mapping neural network
Ying Lin Yu, Wei Zhang
Author Affiliations +
Abstract
How to determine the element numbers in hidden Layers is a key problem in architecture design of a multi-layer ANN (Artificial Neural Network). In order to solve this problem we propose a growth model of elements in hidden layer. In a multi-layer ANN, (for example three layers) the element numbers in input and output layer are obviously determined by the requirements of a given problem, but the problem of how to determine the element numbers in hidden layer is left with a certain randomness. It is sure that the more complex the problem, the higher the degree of nonlinearity, the higher the accuracy is required, and the larger amounts of hidden layer elements are needed. The approach adopted to this problem is briefly described as follows. we first use a fewer hidden layer elements, and check whether this amounts meet the requirements of the given problem complexity, if this fails to meet it, a new element can be grown out. Working in this way until given requirements can be fmnaly satisfied, we get an ANN architecture with a properly determined hidden layer element numbers. The neccessary steps are as follows. (1). Determine the element numbers both in input and output layer according to the given requirements, select an initial amount of the hidden layer elements and form an initial ANN. (2). Set a given training accuracy E , and set a maximun value K of the grown elements in hidden layer. (3). Train the initial ANN by a faster BP algorithm, and get a fmnal error e. (4). If Ie < E , stop. (5). Record the Value L, which denotes the times that Ie < , if L <K, then return to step (3) to get off the occasional errors. (6). If L <K, add one or more new elements to the initial hidden layer, based on these all trained parameters, go back to step (3). Finnaly, we get a grown stable ANN architecture. Computer simulation results are shown in Tab.1
© (1993) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Ying Lin Yu and Wei Zhang "Studies on some properties of a mapping neural network", Proc. SPIE 1965, Applications of Artificial Neural Networks IV, (2 September 1993); https://doi.org/10.1117/12.152538
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Fractal analysis

Artificial neural networks

Neural networks

Computer simulations

Associative arrays

Lithium

Detection and tracking algorithms

RELATED CONTENT


Back to Top