Automatic Differentiation

Input: code compute a function Output: code compute the derivative of the function

Actual implementations of this at Autograd and Jax

AD writes functions as sequence of compositions block $f(x)=f_n\circ f_{n-1}\circ \dots \circ f_1(x)$, and then computes the derivative of the function by applying the chain rule.