Gradient

A **gradient** is a vector that shows the direction and rate of the steepest increase of a function. Each component of the gradient is the **partial derivative** of the function with respect to one input variable. In optimization, it tells you how to adjust inputs to increase or decrease the function’s output most efficiently.