41
/
AIzaSyB4mHJ5NPEv-XzF7P6NDYXjlkCWaeKw5bc
May 31, 2026
8561939
815425
2
Create a timeline
Public Timelines
For companies For educational institutions For teachers For students Dashboard
For educational institutions For teachers For students Dashboard
FAQ
Create a timeline
Public timelines
FAQ
About & FeedbackTermsPrivacyFAQ
Support 24/7  
DashboardGet premium
Donate

jan 1, 2021 - Switch Transformers

Description:

Switch Transformers (Jan 2021)(1.6T params)

- Focus: Implementing a mixture-of-experts implementation of transformer-based LLM and large scaling
- Span denoising

Added to timeline:

LLM timeline

ByJustin Milner
14 Aug 2023
0
0
1775

Date:

jan 1, 2021
Now
~ 5 years and 5 months ago
About & FeedbackTermsPrivacyFAQ
Support 24/7  
DashboardGet premium
Donate
The service accepts bank transfer (ACH, Wire) or cards (Visa, MasterCard, etc). Processed by Stripe.
Secured with SSL