Popularized through LLMs, GPT-3 paper,
See also: $7.1 of The Little Book of Deep Learning
I do think it should be thought as Intelligence amplification rather than “artificial intelligence” system.
Scaling laws
Initial work from OpenAI
Distributed serving of large models requires cost-efficient methods1
large world models
See github