On the approximation by single hidden layer feedforward neural networks with fixed weights
Abstract
Feedforward neural networks have wide applicability in various disciplines of science due to their universal approximation property. Some authors have shown that single hidden layer feedforward neural networks (SLFNs) with fixed weights still possess the universal approximation property provided that approximated functions are univariate. But this phenomenon does not lay any restrictions on the number of neurons in the hidden layer. The more this number, the more the probability of the considered network to give precise results. In this note, we constructively prove that SLFNs with the fixed weight $1$ and two neurons in the hidden layer can approximate any continuous function on a compact subset of the real line. The applicability of this result is demonstrated in various numerical examples. Finally, we show that SLFNs with fixed weights cannot approximate all continuous multivariate functions.
 Publication:

arXiv eprints
 Pub Date:
 August 2017
 arXiv:
 arXiv:1708.06219
 Bibcode:
 2017arXiv170806219G
 Keywords:

 Computer Science  Neural and Evolutionary Computing;
 Computer Science  Information Theory;
 Mathematics  Numerical Analysis;
 41A30;
 41A63;
 65D15;
 68T05;
 92B20;
 C.1.3;
 F.1.1;
 I.2.6;
 I.5.1
 EPrint:
 17 pages, 5 figures, submitted