Essay · AI Blog · Lil'Log · Lilian Weng
How to Train Really Large Models on Many GPUs?
Summary · 摘要
[Updated on 2022-03-13: add expert choice routing.] [Updated on 2022-06-10]: Greg and I wrote a shor…
阅读原文 lilianweng.github.io
继续读 · Essay · AI Blog