♎
Limited AI
search
⌘Ctrlk
♎
Limited AI
  • Machine Learning
  • Deep Learning
  • GenAI
    • Introduction
    • Language Models Pre-training
      • Encoder-Decoder Architecture
      • Encoder Deep Dive
      • Decoder Deep Dive
      • Encoder VS Decoder
      • Attention Mechanism
      • Transformers
    • Example: Llama 3 8B架构
    • MoE layer
    • Fine-Tuning Generation Models
    • RAG and Adavance RAG
    • AI Agent
  • Statistics and Optimization
  • Machine Learning System Design
  • Responsible AI
  • Extra Research
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. GenAI

Language Models Pre-training

Encoder-Decoder Architecturechevron-rightEncoder Deep Divechevron-rightDecoder Deep Divechevron-rightEncoder VS Decoderchevron-rightAttention Mechanismchevron-rightTransformerschevron-right
PreviousGenAI六个阶段chevron-leftNextEncoder-Decoder Architecturechevron-right

Last updated 10 months ago