basic

• Resizual Connection

• Neural Network Models

• applying deep neural networks to natural language processing

• Feature-based vs Fine-tuning

• 矩阵的“秩”最通俗易懂的解释

• Activation functions

  • activation
  • relu
  • sigmoid
  • tanh
  • softmax
  • gelu

• Attention

  • Attention? Attention!
  • additive attention vs dot-product attention
  • NEURAL MACHINE TRANSLATION BY JOINTLY LEARNING TO ALIGN AND TRANSLATE
  • Effective Approaches to Attention-based Neural Machine Translation
  • Attention Is All You Need
  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

• BERT ppt

• GPT

  • GPT-1: Improving Language Understanding by Generative Pre-Training

• gpt-1 vs gpt-2 vs gpt-3

• Fine Tuning

  • 通俗解读大模型微调(Fine Tuning)
  • 大模型低秩适配器LoRA

• Other papers

  • GLM
  • The_NLP_Cookbook_Modern_Recipes_for_Transformer
  • A_Review_of_Deep_Contextualized_Word_Representations
  • Lora
  • QLora
  • A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT