ZeRO: 内存优化实现万亿参数模型训练

from AI Podcast · host weedge

本次播客深入探讨了微软提出的ZeRO技术，该技术通过消除数据和模型并行训练中的内存冗余，显著提高了训练速度并增加了可高效训练的模型大小。

Episode metadata supplied by the publisher feed · Published Mar 6, 2025

Embed this episode

Attribution link and audio player

NOW PLAYING

ZeRO: 内存优化实现万亿参数模型训练

0:00 4:53

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Similar Episodes

No similar episodes found.

No similar podcasts found.

This episode is 4 minutes long.

This episode was published on March 6, 2025.

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!