I’m playing around with calling our tech, as it is today, IA (intelligence amplification) instead of AI. IA have the vibe of tools for thought, needing human interaction, and resemble a lot more what we actually have today. AI feels more like independent long-running agents. https://t.co/vVDH77JI3U
— Andrej Karpathy (@karpathy) 7 janvier 2024
Intelligence should be thought as a tool for thought, not an independent agent
These systems should be built on top of human intelligence, not replace it.
Next-token prediction is primitive to call a system intelligent.
Can a transformers ever be Turing-complete?
research area.
A lot of alpha in mechanistic analysis of the representations these models exhibit., or “virtual brain analysis”.