A Gentle Introduction To Partial Derivatives and Gradient Vectors

Partial derivatives and gradient vectors are used very often in machine learning algorithms for finding the minimum or maximum of a function. Gradient vectors are used in the training of neural networks, logistic regression, and many other classification and regression problems.

In this tutorial, you will discover partial derivatives and the gradient vector.

After completing this tutorial, you will know:

  • Function of several variables
  • Level sets, contours and graphs of a function of two variables
  • Partial derivatives of a function of several variables
  • Gradient vector and its meaning

Let’s get started.