oct 1, 2021 - MT-NLG
Description:
Megatron-Turing NLG(Microsoft/NVIDIA) (Blog Oct 2021)(Paper Jan 2022) (530B params)
- Focus: Training even bigger. Further progress on zero/few-shot capabilities/insights.
- GPT-like
Added to timeline:
Date:
~ 2 years and 7 months ago