Method
gradient
Articles
NUM~
Algorithm
Gradient descent
Finds the minimum of a function by steps against the gradient, in the direction of steepest descent.
O(κ · log(1/ε)) steps
2 problems
ML
Algorithm
Perceptron and backpropagation
Draw a digit: a perceptron from 1958 and a network with a hidden layer, both trained right in the page in a second, read it.
perceptron: O(d) per example; network gradient: O(number of weights) per example
1 problem
Problems
Often together
iterative 2 optimization 1 approximation 1 geodata 1 science and physics 1 classic 1 interviews 1 classification 1 images 1