Bounds on the number of hidden neurons in multilayer perceptrons

作者：S.C. Huang, Yih-Fang Huang · 发表于：IEEE Transactions on Neural Networks · 年份：1991 · DOI：10.1109/72.80290 · 被引用次数：329 · 研究领域：Neural Networks and Applications、Fuzzy Logic and Control Systems、Blind Source Separation Techniques

Fundamental issues concerning the capability of multilayer perceptrons with one hidden layer are investigated. The studies are focused on realizations of functions which map from a finite subset of E(n) into E(d). Real-valued and binary-valued functions are considered. In particular, a least upper bound is derived for the number of hidden neurons needed to realize an arbitrary function which maps from a finite subset of E(n ) into E(d). A nontrivial lower bound is also obtained for realizations of injective functions. This result can be applied in studies of pattern recognition and database retrieval. An upper bound is given for realizing binary-valued functions that are related to pattern-classification problems.