⌘Ctrlk

Machine Learning
Deep Learning
GenAI
Statistics and Optimization
Machine Learning System Design
Responsible AI
Extra Research

Powered by GitBook

On this page

Deep Learning
Attention Mechanisms and Transformers

Large-Scaling Pretraning with Transformers

More Details in NLP pre-train

Reference

https://d2l.ai/chapter_attention-mechanisms-and-transformers/large-pretraining-transformers.html
https://d2l.ai/chapter_attention-mechanisms-and-transformers/large-pretraining-transformers.html

Previous最短的最大路径长度 NextBERT vs OpenAI GPT vs ELMo

Last updated 1 year ago