---
date: '2024-02-07'
description: and provide high-quality "sensors" to 'strong intelligence systems'.
id: RAG
modified: 2026-06-05 15:08:22 GMT-04:00
tags:
  - technical
  - ml
title: RAG
created: '2024-02-07'
published: '2024-02-07'
pageLayout: default
slug: thoughts/RAG
permalink: https://aarnphm.xyz/thoughts/RAG.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
Since models has finite memory, limited context windows, generations often leads to “hallucinations” and lack of cohesion

The idea of RAG is to combine a pretrained retriever and a seq2seq to do end-to-end fine tuning. (@lewis2021retrievalaugmentedgenerationknowledgeintensivenlp)

Two core components include [[thoughts/Embedding|embeddings]] and vector databases.

Very useful for building “agents”: Agents are complex RAG application.