profile pic
⌘ '
raccourcis clavier

see also: Autograd and Jax

Input: code compute a function Output: code compute the derivative of the function

AD writes functions as sequence of compositions block f(x)=fnfn1f1(x)f(x) = f_n \circ f_{n-1} \circ \ldots \circ f_1(x), and then computes the derivative of the function by applying the chain rule.