The function of deep learning
Untangling definitions
The function of deep learning
Untangling definitions
AI
-
Algorithmic
-
Cybernetic
-
Machine learning
-
Deep learning
The function of deep learning
Untangling definitions
Cybernetic
- Multidisciplinary
- Concerned with:
-
Systems
-
Autonomous actors
-
Feedback loops
- Informed and developed in parallel with:
-
Nonlinear control theory
-
Information theory
-
Computer science
The function of deep learning
Untangling definitions
Algorithms
- Sequences of instructions
- Precise, finite, predictable
- No The Algorithm
The function of deep learning
Untangling definitions
Machine learning
- Self-learning algorithm is a poor metaphor
- In practice weak relation to cybernetics
- Statistics
- Approximates algorithms
- Historically more than neural networks
The function of deep learning
Untangling definitions
Deep learning
-
Neural networks
- hidden layers of neurons.
- Needs plenty of processing power
- Needs Big Data
- Approximates hard to design algorithms
The function of deep learning
Untangling definitions
AI
-
Complex systems
-
Many deep neural networks
-
Many algorithm subsystems
The function of deep learning
Untangling definitions
The function of deep learning
Functions and good enough approximations
The function of deep learning
Functions and good enough approximations
\[
f:\overbrace{A}^{domain} \to \underbrace{B}_{codomain}\\
\]
The function of deep learning
Functions and good enough approximations
\[
f:\mathbb{R} \to \mathbb{R}
\]
\[
f(x) = x
\]
The function of deep learning
Functions and good enough approximations
Warm or cold?
\[
f_1:[0..255]^3 \to (-\pi..\pi]
\]
\[
f_1(r,g,b) = atan2(\sqrt{3}(g-b), 2r-g-b)
\]
The function of deep learning
Functions and good enough approximations
Warm or cold?
\[
f_2:(-\pi..\pi] \to \{0, 1\}
\]
\[
f_2(x) = \begin{cases}
0 & \quad \text{if } \color{#00FF00}{120} \gt x \lt \color{#FF00FF}{300} \\
1 & \quad \text{otherwise}
\end{cases}
\]
The function of deep learning
Functions and good enough approximations
Warm or cold?
\[
f_3:[0..255]^3 \to \{0, 1\}
\]
\[
f_3(r,g,b)=f_2(f_1(r,g,b))=
\begin{cases}
0 & \quad \text{if } \color{#00FF00}{120} \gt atan2(\sqrt{3}(g-b), 2r-g-b) \lt \color{#FF00FF}{300} \\
1 & \quad \text{otherwise}
\end{cases}
\]
The function of deep learning
Functions and good enough approximations