This page contains resources about Deep Learning and Representation Learning .
| Attributes | Values |
|---|
| rdfs:label
| - Deep Learning
- Deep learning
|
| rdfs:comment
| - This page contains resources about Deep Learning and Representation Learning .
- Deep learning (also known as deep network learning) is
- There are a number of ways that the field of deep learning has been characterized. Deep learning is a class of machine learning algorithms that
* use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised).
* are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher level features are derived from lower level features to form a hierarchical representation.
* are part of the broader machine learning field of learning representations of data.
* learn multiple levels of represent
|
| sameAs
| |
| dcterms:subject
| |
| dbkwik:babyish/pro...iPageUsesTemplate
| |
| dbkwik:itlaw/prope...iPageUsesTemplate
| |
| abstract
| - This page contains resources about Deep Learning and Representation Learning .
- There are a number of ways that the field of deep learning has been characterized. Deep learning is a class of machine learning algorithms that
* use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised).
* are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher level features are derived from lower level features to form a hierarchical representation.
* are part of the broader machine learning field of learning representations of data.
* learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common (1) multiple layers of nonlinear processing units and (2) the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. The composition of a layer of nonlinear processing units used in a deep learning algorithm depends on the problem to be solved. Layers that have been used in deep learning include hidden layers of an artificial neural network and sets of complicated propositional formulas. They may also include latent variables organized layer-wise in deep generative models such as the nodes in Deep Belief Networks and Deep Boltzmann Machines. Deep learning algorithms are contrasted with shallow learning algorithms by the number of parameterized transformations a signal encounters as it propagates from the input layer to the output layer, where a parameterized transformation is a processing unit that has trainable parameters, such as weights and thresholds. A chain of transformations from input to output is a credit assignment path (CAP). CAPs describe potentially causal connections between input and output and may vary in length. For a feedforward neural network, the depth of the CAPs, and thus the depth of the network, is the number of hidden layers plus one (the output layer is also parameterized). For recurrent neural networks, in which a signal may propagate through a layer more than once, the CAP is potentially unlimited in length. There is no universally agreed upon threshold of depth dividing shallow learning from deep learning, but most researchers in the field agree that deep learning has multiple nonlinear layers (CAP > 2) and Schmidhuber considers CAP > 10 to be very deep learning.
- Deep learning (also known as deep network learning) is
|