41
/
AIzaSyB4mHJ5NPEv-XzF7P6NDYXjlkCWaeKw5bc
May 31, 2026
8561933
815425
2
Public Timelines
FAQ

oct 1, 2019 - Distillbert

Description:

Distillbert (Oct 2019)(Hugging Face)

- Focus: Distilled form of the BERT model. Reduced size 40%, retaining 97% of language capabilities
- Same general architecture as BERT

Added to timeline:

14 Aug 2023
0
0
1775

Date:

oct 1, 2019
Now
~ 6 years and 8 months ago