Essay · AI Blog · Lil'Log · Lilian Weng

How to Train Really Large Models on Many GPUs?

2021-09-24 · 1882 天前 English
Summary · 摘要

[Updated on 2022-03-13: add expert choice routing.] [Updated on 2022-06-10]: Greg and I wrote a shor…

阅读原文 lilianweng.github.io