OpenAI's starts training GPT-5 🤖 // Jan Leike joins Anthropic's Superalignment Team 👥 // MoEUT Outperforms Standard Transformers 💥 episode artwork

EPISODE · May 29, 2024 · 15 MIN

OpenAI's starts training GPT-5 🤖 // Jan Leike joins Anthropic's Superalignment Team 👥 // MoEUT Outperforms Standard Transformers 💥

from GPT Reviews · host Earkind

OpenAI has formed a new safety team to address concerns about AI safety and ethics, led by CEO Sam Altman and board members Adam D’Angelo and Nicole Seligman. Jan Leike, a leading AI researcher, has left OpenAI and joined Anthropic's Superalignment team, which is focused on AI safety and security. The latest version of Sentence Transformers v3 has been released, allowing for finetuning of models for specific tasks like semantic search and paraphrase mining. Exciting new research papers have been published, including MoEUT, a shared-layer Transformer design that outperforms standard Transformers on language modeling tasks, and EM Distillation, a new distillation method for diffusion models that efficiently distills them to one-step generator models without sacrificing perceptual quality. Contact:  [email protected] Timestamps: 00:34 Introduction 01:32 OpenAI has a new safety team — it’s run by Sam Altman 03:18 Jan Leike (ex OpenAI) joins Anthropic's Superalignment Team 05:04 Sentence Transformers v3 Released 06:06 Fake sponsor 08:19 MoEUT: Mixture-of-Experts Universal Transformers 10:10 Greedy Growing Enables High-Resolution Pixel-Based Diffusion Models 11:48 EM Distillation for One-step Diffusion Models 13:42 Outro

Episode metadata supplied by the publisher feed · Published May 29, 2024

Embed this episode

NOW PLAYING

OpenAI's starts training GPT-5 🤖 // Jan Leike joins Anthropic's Superalignment Team 👥 // MoEUT Outperforms Standard Transformers 💥

0:00 15:02

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of GPT Reviews?

This episode is 15 minutes long.

When was this GPT Reviews episode published?

This episode was published on May 29, 2024.

Can I download this GPT Reviews episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!