Quire

Hidden layer

From Quire, the open reference·Type of layer in artificial neural networks·1 min read
Example of hidden layers in a MLP
Example of hidden layers in a MLP Image: source and license

In artificial neural networks, a hidden layer is a layer of artificial neurons that is neither an input layer nor an output layer. The simplest examples appear in multilayer perceptrons (MLP), as illustrated in the diagram.[1]

An MLP without any hidden layer is essentially just a linear model. With hidden layers and activation functions, however, nonlinearity is introduced into the model.[1]

In typical machine learning practice, the weights and biases are initialized, then iteratively updated during training via backpropagation.[1]

References#edit

  1. ^ a b c Zhang, Aston; Lipton, Zachary; Li, Mu; Smola, Alexander J. (2024). "5.1. Multilayer Perceptrons". Dive into deep learning. Cambridge New York Port Melbourne New Delhi Singapore: Cambridge University Press. ISBN 978-1-009-38943-3.


This article is mirrored from “Hidden layer” on English Wikipedia, revision 1354276118, written by Wikipedia's contributors and licensed CC BY-SA 4.0. Editing it here creates a Quire copy with its own history.

Synced with Wikipedia revision 1354276118 · just now