Flash Attention 1 & 2

Um..! 28 posts in total. Keep on posting.

20257

01-20

Flash Attention 1 & 2

01-18

Megatron-Turing NLG 530B

01-18

Other papers on DeepSpeed-MoE

01-15

DeepSpeed-MoE

01-13

ZeRO-Infinity

01-13

ZeRO-Offload

01-01

ZeRO (DeepSpeed from Microsoft)

202419

12-28

How to check remote hexo webpages in our local computer

12-26

Megatron-LM (3)

12-26

Megatron-LM (2)