Skip to content
OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions episode artwork

May 13, 2024 14 min

OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions

from Interconnects Hosted by Nathan Lambert

Now we will have some grounding for when weird ChatGPT behaviors are intended or side-effects -- shrinking the Overton window of RLHF bugs. This is AI generated audio with Python and 11Labs. Source code: https://github.com/natolambert/interconnects-tools Original post: https://www.interconnects.ai/p/openai-rlhf-model-spec 00:00 OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions 02:56 Reviewing the Model Spec 08:26 Where RLHF can fail OpenAI 12:23 From Model Spec's to personalization Fig 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/model-spec/img_027.png Fig 2: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/model-spec/img_029.png Fig 3: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/model-spec/img_033.png Fig 4: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/model-spec/img_034.png Fig 5: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/model-spec/img_041.webp Fig 6: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/model-spec/img_046.webp This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.interconnects.ai/subscribe

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions

0:00 14:05

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

Audistorium Stygian Catalyst Audistorium is a multi-genre spanning dark anthology audio drama created by Landon 'Lemon' Whisnant. From dread horror to absurdist comedy, Audistorium weaves a web of its own that interconnects It's stories in its own macabre, sometimes goofy way. Produced by Stygian Catalyst and co-creator of the Questionable Guide to Life Podcast. At the caring chiding of those close to us, we have decided to open up a way for people to contribute to the shows production, for the price of a simple cup of coffee, you can support Audistorium by clicking here for our Ko-Fi page. For contact, email us at [email protected], We can be found @AudistoriumPod on Twitter You can find Landon <a href="https://open.acast.com/shows/653838418299010011ba94bc/episodes/@https://twitter.com/Lemjam LCE Insider LC Elektronik LCE Insider is a podcast about real-life applications of printed electronics in industrial, medical and transport devices. It’s made for CEOs, design engineers, buyers and project managers who work with HMI – or want to enter this world. We talk about membrane keypads, printed circuits, sensors, backlighting and flexible interconnects, plus decisions like Europe vs Asia, cost vs risk and supplier strategy. Created by LC Elektronik, a Polish manufacturer and HMI integrator.

Frequently asked questions

How long is this episode of Interconnects?

This episode is 14 minutes long.

When was this Interconnects episode published?

This episode was published on May 13, 2024.

Can I download this Interconnects episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.