feb 1, 2020 - T5

Description:

T5 (Google)(Blog Feb 24 2020)(Paper July 28 2020)(11B params)(700GB dataset)

- Focus: Text-to-text format. Review of transfer learning techniques. Applying the most effective ones together.
- Encoder-Decoder, span-denoising unsupervised objective, multiple supervised objectives

Added to timeline:

Date: