Machine learning

Detects pattern within data and use it to make useful prediction.

Generally AI $\subset$ ML $\subset$ DL

Some main exploration:

• Transformers
• CNN
• Optimization
  • Gradient descent
  • hyperparameter tuning
• Recommender systems
• Reinforcement learning
  • Q-learning
  • Policy Gradient
  • Monte-Carlo Tree Search
• Generative Models
  • GAN
  • VAE
• Autoencoder
• Supervised Q-learning
• Low-rank adapters

Fields

• mechanistic interpretability

Related:

• linear algebra.
• autograd
• supervised machine learning.