The function of deep learning

Untangling definitions

The function of deep learning

Untangling definitions

AI
  • Algorithmic
  • Cybernetic
  • Machine learning
  • Deep learning

The function of deep learning

Untangling definitions

Cybernetic

  • Multidisciplinary
  • Concerned with:
    • Systems
    • Autonomous actors
    • Feedback loops
  • Informed and developed in parallel with:
    • Nonlinear control theory
    • Information theory
    • Computer science

The function of deep learning

Untangling definitions

Algorithms

  • Sequences of instructions
  • Precise, finite, predictable
  • No The Algorithm

The function of deep learning

Untangling definitions

Machine learning

  • Self-learning algorithm is a poor metaphor
  • In practice weak relation to cybernetics
  • Statistics
  • Approximates algorithms
  • Historically more than neural networks
    • now not so much

The function of deep learning

Untangling definitions

Deep learning

  • Neural networks
    • hidden layers of neurons.
  • Needs plenty of processing power
  • Needs Big Data
  • Approximates hard to design algorithms

The function of deep learning

Untangling definitions

AI
  • Complex systems
  • Many deep neural networks
  • Many algorithm subsystems

The function of deep learning

Untangling definitions

AI Sometimes it's a scam

The function of deep learning

Functions and good enough approximations

The function of deep learning

Functions and good enough approximations

\[ f:\overbrace{A}^{domain} \to \underbrace{B}_{codomain}\\ \]

The function of deep learning

Functions and good enough approximations

\[ f:\mathbb{R} \to \mathbb{R} \] \[ f(x) = x \]

The function of deep learning

Functions and good enough approximations

Warm or cold?
\[ f_1:[0..255]^3 \to (-\pi..\pi] \]
\[ f_1(r,g,b) = atan2(\sqrt{3}(g-b), 2r-g-b) \]

The function of deep learning

Functions and good enough approximations

Warm or cold?
\[ f_2:(-\pi..\pi] \to \{0, 1\} \]
\[ f_2(x) = \begin{cases} 0 & \quad \text{if } \color{#00FF00}{120} \gt x \lt \color{#FF00FF}{300} \\ 1 & \quad \text{otherwise} \end{cases} \]

The function of deep learning

Functions and good enough approximations

Warm or cold?
\[ f_3:[0..255]^3 \to \{0, 1\} \]
\[ f_3(r,g,b)=f_2(f_1(r,g,b))= \begin{cases} 0 & \quad \text{if } \color{#00FF00}{120} \gt atan2(\sqrt{3}(g-b), 2r-g-b) \lt \color{#FF00FF}{300} \\ 1 & \quad \text{otherwise} \end{cases} \]

The function of deep learning

Functions and good enough approximations

Warm or cold?
Next