oct 1, 2019 - Distillbert
Description:
Distillbert (Oct 2019)(Hugging Face)
- Focus: Distilled form of the BERT model. Reduced size 40%, retaining 97% of language capabilities
- Same general architecture as BERT
Added to timeline:
Date:
~ 4 years and 7 months ago