CtrlK

Machine Learning
Deep Learning
GenAI
Statistics and Optimization
Machine Learning System Design
- Extra Reading
- Introduction
Responsible AI
- AI Risk and Uncertainty
- xAI
  - SHAP value
Extra Research
- Paper Reading
- Reference

Powered by GitBook

On this page

Deep Learning
Attention Mechanisms and Transformers

Large-Scaling Pretraning with Transformers

More Details in NLP pre-train

Reference

https://d2l.ai/chapter_attention-mechanisms-and-transformers/large-pretraining-transformers.html
https://d2l.ai/chapter_attention-mechanisms-and-transformers/large-pretraining-transformers.html

Previous最短的最大路径长度 NextBERT vs OpenAI GPT vs ELMo

Last updated 10 months ago