“But reducing the amount of communication required by…” — The Changelog: Software Development, Open Source at 21:48
“But reducing the amount of communication required by different layers of AI when you train, you can reduce the need for connectivity. So you can have multiple GPUs in different data islands, we call them, and somehow train them. So this method was proposed by Google DeepMind, which is the most advanced AI lab in the…”
0:00
2:02:37