Lecture 4 of the online course Deep Learning Systems: Algorithms and Implementation.This lecture introduces automatic differentiation. We will go through num…