What is the alternative to intent alignment called? Q by Richard Ngo
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: What is the alternative to intent alignment called? Q, published by Richard Ngo on the AI Al...
First published
11/17/2021
Genres:
education
Listen to this episode
Summary
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: What is the alternative to intent alignment called? Q, published by Richard Ngo on the AI Alignment Forum. Paul defines intent alignment of an AI A to a human H as the criterion that A is trying to do what H wants it to do. What term do people use for the definition of alignment in which A is trying to achieve H's goals (whether or not H intends for A to achieve H's goals)? Secondly, this seems to basically map on to the distinction between an aligned genie and an aligned sovereign. Is this a fair characterisation? (Intent alignment definition from) Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
Duration
Parent Podcast
The Nonlinear Library: Alignment Section
View PodcastSimilar Episodes
What is the alternative to intent alignment called? Q by Richard Ngo
Release Date: 11/17/2021
Description: Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: What is the alternative to intent alignment called? Q, published by Richard Ngo on the AI Alignment Forum. Paul defines intent alignment of an AI A to a human H as the criterion that A is trying to do what H wants it to do. What term do people use for the definition of alignment in which A is trying to achieve H's goals (whether or not H intends for A to achieve H's goals)? Secondly, this seems to basically map on to the distinction between an aligned genie and an aligned sovereign. Is this a fair characterisation? (Intent alignment definition from) Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
Explicit: No
AMA: Paul Christiano, alignment researcher by Paul Christiano
Release Date: 12/06/2021
Description: Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: AMA: Paul Christiano, alignment researcher, published by Paul Christiano on the AI Alignment Forum. I'll be running an Ask Me Anything on this post from Friday (April 30) to Saturday (May 1). If you want to ask something just post a top-level comment; I'll spend at least a day answering questions. You can find some background about me here. Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
Explicit: No
AI alignment landscape by Paul Christiano
Release Date: 11/19/2021
Description: Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: AI alignment landscape, published byPaul Christiano on the AI Alignment Forum. Here (link) is a talk I gave at EA Global 2019, where I describe how intent alignment fits into the broader landscape of “making AI go well,” and how my work fits into intent alignment. This is particularly helpful if you want to understand what I’m doing, but may also be useful more broadly. I often find myself wishing people were clearer about some of these distinctions. Here is the main overview slide from the talk: The highlighted boxes are where I spend most of my time. Here are the full slides from the talk. Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
Explicit: No
Announcing the Alignment Research Center by Paul Christiano
Release Date: 11/19/2021
Description: Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Announcing the Alignment Research Center, published by on the AI Alignment Forum. (Cross-post from ai-alignment.com) I’m now working full-time on the Alignment Research Center (ARC), a new non-profit focused on intent alignment research. I left OpenAI at the end of January and I’ve spent the last few months planning, doing some theoretical research, doing some logistical set-up, and taking time off. For now it’s just me, focusing on theoretical research. I’m currently feeling pretty optimistic about this work: I think there’s a good chance that it will yield big alignment improvements within the next few years, and a good chance that those improvements will be integrated into practice at leading ML labs. My current goal is to build a small team working productively on theory. I’m not yet sure how we’ll approach hiring, but if you’re potentially interested in joining you can fill out this tiny form to get notified when we’re ready. Over the medium term (and maybe starting quite soon) I also expect to implement and study techniques that emerge from theoretical work, to help ML labs adopt alignment techniques, and to work on alignment forecasting and strategy. Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
Explicit: No
Similar Podcasts
The Nonlinear Library
Release Date: 10/07/2021
Authors: The Nonlinear Fund
Description: The Nonlinear Library allows you to easily listen to top EA and rationalist content on your podcast player. We use text-to-speech software to create an automatically updating repository of audio content from the EA Forum, Alignment Forum, LessWrong, and other EA blogs. To find out more, please visit us at nonlinear.org
Explicit: No
Break Room Chats
Release Date: 08/06/2020
Authors: LLAMA NPS
Description: Welcome to Break Room Chats, the podcast of the New Professionals Section of the Library Leadership and Management Association of ALA. To continue the conversation, please visit the New Professionals Section Facebook page at https://www.facebook.com/groups/LLAMA.NPS/ . We're also on twitter @LLAMA_NPS.
Explicit: No
The Marketing Detective
Release Date: 09/25/2020
Authors: Mitch West
Description: Solving the marketing mysteries that challenge local business across linear and nonlinear platforms.
Explicit: No
Test Nonlinear
Release Date: 05/19/2021
Description: Test RSS podcast feed for Nonlinear Tech Internship
Explicit: No
Section Cut
Release Date: 09/10/2020
Authors: Section Cut
Description: SectionCut is a curated collection of DIGITAL and ANALOG design resources and HOW TO's to assist with complex workflows acting as a cross section of design information. As a cross section of highly valued design information, S|C provides a glimpse into the contemporary designer's library of resources.
Explicit: No
Ryan’s Ramble
Release Date: 08/12/2020
Authors: Ryan Aratin
Description: Nonlinear podcast about ideas or experiences with in my life.
Explicit: No
Nonlinear
Release Date: 12/17/2020
Authors: Teal
Description: Everyone's career path is different, built by pivotal moments and choices. We're on a mission to amplify those stories and examine how our decisions shape our careers. Nonlinear is hosted by Dave Fano, Founder & CEO of Teal—a genuinely consumer-first platform designed to help people grow and manage their careers. Our goal is to empower people to land jobs they love with free tools that guide and automate the process. Learn more at tealhq.com.
Explicit: No
The Noisy Library by Story Stitchers
Release Date: 04/28/2021
Authors: Story Stitchers
Description: A place for stories to be found and voices to be heard.The Noisy Library is online space curated by Story Stitchers CIC to showcase stories and voices. We welcome any kind of story to our library whether it is a poem, memory, song, family saga or an imagined place.Here you can find the stories for grown ups. We think that this section on the library is suitable for audiences aged 13 plus if you are under 13 , you should check out out children’s Library
Explicit: No
Nonfiction Friends
Release Date: 08/29/2020
Authors: Osceola Library System
Description: Nonfiction Friends is an educational, library-based podcast that seeks to help the public learn interesting, quirky, and sometimes bizarre facts that can be found in the nonfiction section of their local library.Follow us on Twitter!https://twitter.com/nffriendscast
Explicit: No
Oxford Union Library Audio Tour
Release Date: 09/01/2020
Authors: Oxford University
Description: An audio tour of the historic Oxford Union Library. Since its foundation, the Union has maintained a library for the use of its members. One of the largest lending libraries in Oxford, it is of particular relevance to students studying Classics, English, History, Law, PPE and Theology. In recent years, the Science section has been expanded. The library has a significant collection of 19th century publications, both books and journals, which would be of special interest to researchers studying that period.
Explicit: No
Dun Laoghaire Rathdown County Library
Release Date: 08/18/2020
Description: The Library Section of Dun Laoghaire Rathdown County Council run a varied programme of literary events throughout the year. This podcast series provides an archive of some of these events and helps to extend their reach to a wider audience.
Explicit: No
Symmetry, Bifurcation and Multi-Agent Decision Making - Naomi Leonard 26th April 2019
Release Date: 08/07/2021
Description: I will present nonlinear dynamics for distributed decision-making that derive from principles of symmetry and bifurcation. Inspired by studies of animal groups, including house-hunting honeybees and schooling fish, the nonlinear dynamics describe a group of interacting agents that can manage flexibility as well as stability in response to a changing environment.
Explicit: No