41
/
AIzaSyB4mHJ5NPEv-XzF7P6NDYXjlkCWaeKw5bc
May 31, 2026
8561932
815425
2
Public Timelines
FAQ

sep 1, 2019 - Megatron-LM

Description:

Megatron-LM (Sep 2019)(NVIDIA)(8.3B params)(37GB data)

- Focus: Training parallelism/efficiency, further zero-shot progression
- GPT-2 variant

Added to timeline:

14 Aug 2023
0
0
1775

Date:

sep 1, 2019
Now
~ 6 years and 9 months ago