RLHF: A thin line between useful and lobotomized
from Interconnects Hosted by Nathan Lambert
Many, many signs of life for preference fine-tuning beyond spoofing chat evaluation tools. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/how-rlhf-works-2 00:00 How RLHF works, part 2: A thin line between useful and lobotomized 04:27 The chattiness paradox 08:09 The mechanism for making models chattier 10:42 Next steps for RLHF research Fig 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/rlhf/img_012.webp Fig 2: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/rlhf/img_018.png Fig 3: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/rlhf/img_025.png This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.interconnects.ai/subscribe
Embed this episode
No transcript yet.