dec 1, 2021 - RETRO
Description:
RETRO (DeepMind)(Blog and paper Dec 2021)(7B params)
- Focus: Explicit memory through nearest neighbor embedding search and cross attention
- NWP, utilizes BERT embeddings for memory retrieval
Added to timeline:
Date:
~ 2 years and 5 months ago