EPISODE · Jan 17, 2025 · 15 MIN
LLaMA-2
from Large Language Model (LLM) Talk · host AI-Talk
LLaMA-2 is a collection of large language models (LLMs), with pretrained and fine-tuned versions ranging from 7 billion to 70 billion parameters. The fine-tuned models, called Llama 2-Chat, are designed for dialogue and outperform open-source models on various benchmarks. The models were trained on 2 trillion tokens of publicly available data, and were optimized for both helpfulness and safety using techniques such as supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF). Llama 2 also includes a novel technique, Ghost Attention (GAtt), to maintain dialogue flow.
What this episode covers
LLaMA-2 is a collection of large language models (LLMs), with pretrained and fine-tuned versions ranging from 7 billion to 70 billion parameters. The fine-tuned models, called Llama 2-Chat, are designed for dialogue and outperform open-source models on various benchmarks. The models were trained on 2 trillion tokens of publicly available data, and were optimized for both helpfulness and safety using techniques such as supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF). Llama 2 also includes a novel technique, Ghost Attention (GAtt), to maintain dialogue flow.
NOW PLAYING
LLaMA-2
No transcript for this episode yet
Similar Episodes
Feb 8, 2026 ·4m
Jan 30, 2026 ·6m
Dec 15, 2025 ·2m
Nov 30, 2025 ·5m
Oct 26, 2025 ·14m
Oct 26, 2025 ·61m