A comprehensive review on the problem of choosing a suitable activation function for the hidden layer of a feed forward neural network has been widely investigated. Since the nonlinear component of a neural network is the main contributor to the network mapping capabilities, the different choices that may lead to enhanced performances, in terms of training, generalization, or computational costs, are analyzed, both in general-purpose and in embedded computing environments. Finally, a strategy to convert a network configuration between different activation functions without altering the network mapping capabilities will be presented.

Laudani, A., Lozito, G.M., RIGANTI FULGINEI, F., Salvini, A. (2015). On Training Efficiency and Computational Costs of a Feed Forward Neural Network: A Review. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2015, 1-13 [10.1155/2015/818243].

On Training Efficiency and Computational Costs of a Feed Forward Neural Network: A Review

LAUDANI, ANTONINO;LOZITO, GABRIELE MARIA;RIGANTI FULGINEI, Francesco;SALVINI, Alessandro
2015-01-01

Abstract

A comprehensive review on the problem of choosing a suitable activation function for the hidden layer of a feed forward neural network has been widely investigated. Since the nonlinear component of a neural network is the main contributor to the network mapping capabilities, the different choices that may lead to enhanced performances, in terms of training, generalization, or computational costs, are analyzed, both in general-purpose and in embedded computing environments. Finally, a strategy to convert a network configuration between different activation functions without altering the network mapping capabilities will be presented.
2015
Laudani, A., Lozito, G.M., RIGANTI FULGINEI, F., Salvini, A. (2015). On Training Efficiency and Computational Costs of a Feed Forward Neural Network: A Review. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2015, 1-13 [10.1155/2015/818243].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11590/283334
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 61
  • ???jsp.display-item.citation.isi??? 46
social impact