profile pic
⌘ '
raccourcis clavier
Search

AGI

  • Étiquette

    • publié à

    • modifié à

    • durée

      1 min de lecture

    • source

      llms.txt

    The proposal is that such an AGI would be able to understand or learn any intellectual task that a human being can. It would also be able to learn and improve itself, and possibly be able to do things that humans cannot do.

    We saw “some sparks” in LLMs that it can “understand” natural language

    See also Yann’s chat with Lex

    Vous pourriez aimer ce qui suit

  • cryptography
  • Embedding
  • HTTP
  • Transaction
  • Constructionist
  • Second-order systems
  • computational poem
    • On ChatGPT and its pedagogical consequences
    And its implication on how we assess learning. an overview.
    LLMs
    large language models, often implemented as autoregressive transformers models. GPTs and friends Most variants of LLMs are decoder-only (Radford et al., 2019) Have “capabilities” to understand natural language.
    Machine learning
    Detects pattern within data and use it to make useful prediction. Generally AI \subset ML \subset DL Some main exploration: Transformers Large language models NLP CNN Logistic regression Optimization gradient descent hyperparameter tuning ensemble learning Recommender systems Reinforcement learning Q-learning Policy Gradient Monte-Carlo Tree Search Generative Models GAN VAE Autoencoder sparse autoencoder sparse crosscoders Supervised Q-learning Low-rank adapters Fields mechanistic interpretability Related: linear algebra.
    Ethics template a la carte
    and exercise.