Exponential Moving Average

An exponential moving average (EMA) smooths a sequence by giving more weight to recent values:

• : current value or model parameters
• : smoothing factor
• : previous average

A larger reacts faster to new values; a smaller produces stronger smoothing. A common initialization is .