Optimizer

Goal of a model is to reach the minimum of the loss function

Optimizer defines how to tweak the parameters to get closer to the minima

• - learning rate