jan 1, 2021 - Switch Transformers
Description:
Switch Transformers (Jan 2021)(1.6T params)
- Focus: Implementing a mixture-of-experts implementation of transformer-based LLM and large scaling
- Span denoising
Added to timeline:
Date:
~ 3 years and 4 months ago