30
/
AIzaSyAYiBZKx7MnpbEhh9jyipgxe19OcubqV5w
April 1, 2024
8561946
815425
2

oct 1, 2021 - MT-NLG

Description:

Megatron-Turing NLG(Microsoft/NVIDIA) (Blog Oct 2021)(Paper Jan 2022) (530B params)

- Focus: Training even bigger. Further progress on zero/few-shot capabilities/insights.
- GPT-like

Added to timeline:

9 months ago

Date:

oct 1, 2021
Now
~ 2 years and 7 months ago