30
/
AIzaSyAYiBZKx7MnpbEhh9jyipgxe19OcubqV5w
April 1, 2024
8561932
815425
2

sep 1, 2019 - Megatron-LM

Description:

Megatron-LM (Sep 2019)(NVIDIA)(8.3B params)(37GB data)

- Focus: Training parallelism/efficiency, further zero-shot progression
- GPT-2 variant

Added to timeline:

9 months ago

Date:

sep 1, 2019
Now
~ 4 years and 8 months ago