Does GPT-3 lie? - Misinformation and fear-mongering around the TruthfulQA dataset episode artwork

EPISODE · Sep 24, 2021 · 13 MIN

Does GPT-3 lie? - Misinformation and fear-mongering around the TruthfulQA dataset

from Yannic Kilcher Videos (Audio Only) · host Yannic Kilcher

#gpt-3 #truth #conspiracy A new benchmark paper has created quite an uproar in the community. TruthfulQA is a dataset of 817 questions probing for imitative falsehoods where language models become less truthful, the larger they get. This surprising counter-intuitive finding validates many people's criticisms of large language models, but is it really the correct conclusion? OUTLINE: 0:00 - Intro 0:30 - Twitter Paper Announcement 4:10 - Large Language Models are to blame! 5:50 - How was the dataset constructed? 9:25 - The questions are adversarial 12:30 - Are you surprised?! Paper: https://arxiv.org/abs/2109.07958 Links: TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher Discord: https://discord.gg/4H8xxDF BitChute: https://www.bitchute.com/channel/yann... Minds: https://www.minds.com/ykilcher Parler: https://parler.com/profile/YannicKilcher LinkedIn: https://www.linkedin.com/in/ykilcher BiliBili: https://space.bilibili.com/1824646584 If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): SubscribeStar: https://www.subscribestar.com/yannick... Patreon: https://www.patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

Episode metadata supplied by the publisher feed · Published Sep 24, 2021

Embed this episode

NOW PLAYING

Does GPT-3 lie? - Misinformation and fear-mongering around the TruthfulQA dataset

0:00 13:18

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Yannic Kilcher Videos (Audio Only)?

This episode is 13 minutes long.

When was this Yannic Kilcher Videos (Audio Only) episode published?

This episode was published on September 24, 2021.

Can I download this Yannic Kilcher Videos (Audio Only) episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!