Skip to content
RAFT: In-Domain Retrieval-Augmented Fine-Tuning for Language Models episode artwork

Mar 27, 2025 20 min

RAFT: In-Domain Retrieval-Augmented Fine-Tuning for Language Models

from Best AI papers explained Hosted by Enoch H. Kang

This paper introduces Retrieval Augmented Fine Tuning (RAFT), a novel training method designed to improve large language models' ability to answer questions accurately within specific domains when provided with relevant documents. RAFT trains models to effectively utilize provided documents by incorporating both helpful and distracting information during fine-tuning, encouraging the model to discern and cite relevant passages. The research demonstrates that RAFT enhances performance on domain-specific question answering tasks across various datasets compared to standard fine-tuning approaches, even when using retrieval-augmented generation. Key elements of RAFT include training with distractor documents and generating chain-of-thought reasoning grounded in the provided context.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

RAFT: In-Domain Retrieval-Augmented Fine-Tuning for Language Models

0:00 20:36

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Best AI papers explained?

This episode is 20 minutes long.

When was this Best AI papers explained episode published?

This episode was published on March 27, 2025.

Can I download this Best AI papers explained episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.