---
date: '2024-02-07'
description: techniques to evaluate partial derivative of a functions specified by CP.
id: Automatic Differentiation
modified: 2026-06-05 15:08:20 GMT-04:00
seealso:
  - '[[thoughts/Autograd|Autograd]]'
  - '[[thoughts/Jax|JAX]]'
tags:
  - math
title: Automatic Differentiation
created: '2024-02-07'
published: '2024-02-07'
pageLayout: default
slug: thoughts/Automatic-Differentiation
permalink: https://aarnphm.xyz/thoughts/Automatic-Differentiation.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
Input: code compute a function
Output: code compute the derivative of the function

AD writes functions as sequence of compositions block $f(x) = f_n \circ f_{n-1} \circ \ldots \circ f_1(x)$, and then computes the derivative of the function by applying the chain rule.