Skip to content
Somewhat Contra Marcus On AI Scaling episode artwork

Jun 11, 2022 32 min

Somewhat Contra Marcus On AI Scaling

from Astral Codex Ten Podcast

https://astralcodexten.substack.com/p/somewhat-contra-marcus-on-ai-scaling I. Previously: I predicted that DALL-E's many flaws would be fixed quickly in future updates. As evidence, I cited Gary Marcus' lists of GPT's flaws, most of which got fixed quickly in future updates. Marcus responded with a post on his own Substack, arguing . . . well, arguing enough things that I'm nervous quoting one part as the thesis, and you should read the whole post, but if I had to do it, it would be: Now it is true that GPT-3 is genuinely better than GPT-2, and maybe (but maybe not, see footnote 1) true that InstructGPT is genuinely better than GPT-3. I do think that for any given example, the probability of a correct answer has gone up. [Scott] is quite right about that, at least for GPT-2 to GPT-3. But I see no reason whatsoever to think that the underlying problem — a lack of cognitive models of the world —have been remedied. The improvements, such as they are, come, primarily because the newer models have larger and larger sets of data about how human beings use word sequences, and bigger word sequences are certainly helpful for pattern matching machines. But they still don't convey genuine comprehension, and so they are still very easy for Ernie and me (or anyone else who cares to try) to break.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Somewhat Contra Marcus On AI Scaling

0:00 32:58

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Astral Codex Ten Podcast?

This episode is 32 minutes long.

When was this Astral Codex Ten Podcast episode published?

This episode was published on June 11, 2022.

Can I download this Astral Codex Ten Podcast episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.