Course Information

   Yun-Nung (Vivian) Chen
   Virtual (YT Video) / Physical (R103)
   Thursday 09:10 - 12:10

Syllabus

Date Lecture Recitation Note
2023/09/07 Course Logistics [ 0]
Introduction [ 1.1] [ 1.2] [ 1.3] 		Dev Infra & Tooling
[ PyTorch] [ Debugging] 		Virtual
2023/09/14 Neural Network Basics [ 2.1] [ 2.2] [ 2.3] [ 2.4]
Backpropagation [ 2.5]
Virtual
2023/09/21 Word Representation [ 3.1]
Sequence Modeling [ 3.2] [ 3.3] [ 3.4] 		NLP Lifecycle
[ Step by Step] [Colab] 		Physical
2023/09/28 Teachers' Day Break Virtual
2023/10/05 Attention Mechanism [ 4.1] [ 4.2]
Transformer [ 4.3] [ 4.4] [ 4.5] 		Underlying Logics of Projects
[ Step by Step] 		Virtual
2023/10/12 Tokenization [ 5.1]
BERT [ 5.2]
BERT Variants [ 5.3] [ 5.4] [ 5.5] [ 5.6] 		Virtual
2023/10/19 Dr. Nancy F. Chen
Guest Lecture (10:00-11:20) 		Physical
HW 2
2023/10/26 NLG Decoding [ 6.1] [ 6.2] [ 6.3]
NLG Evaluation [ 6.4] [ 6.5]
Virtual
2023/11/02 Midterm Break
彈性補充 Reinforcement Learning [ RL.1] [ RL.2] [ RL.3]
Value-Based RL [ RL.4] [ RL.5] [ RL.6]
自學
彈性補充 Policy Gradient & Actor-Critic [ RL.7] [ RL.8] 自學
2023/11/09 Prompt-Based Learning [ 7.1] [ 7.2] [ 7.3]
[ 7.4] [ 7.5] [ 7.6] [ 7.7] 		LLM Architecture
[ Basics] 		Physical
HW 3
2023/11/16 LLM Adaptation [ 8.1] [ 8.2] [ 8.3] LLM LoRA Training
[ LoRA] 		Physical
2023/11/23 Conversational Modeling [ 9.1] [ 9.2] [ 9.3]
[ 9.4] [ 9.5] 		Physical
2023/11/27 (Mon)
Dr. Shao-Hua Sun 		Guest Lecture (10:00-12:00)
Program-Guided Robot Learning 		Physical
2023/11/30 Final Project Description LLM Inference & Evaluation Physical
2023/12/07 Break
2023/12/13 (Wed)
 Guest Lecture (14:20-16:00)
Cross-Language IR Models 		Physical
2023/12/14 Beyond Supervised Learning
Issues in Pre-Trained Models 		Physical
2023/12/21 Final Project Presentation

Homework

The assignments should be submitted via NTU COOL.
NO LATE SUBMISSION IS ALLOWED!

  • Please make sure that you have computing resources for training deep models.
  • Please make sure that your GitHub repo for homework is private.

Teaching Team

Please send your questions to adl-ta@csie.ntu.edu.tw.
Please make sure the title of your mail starts with [ADL2023].

Role Name Work Office Hour Location
Head TA 林彥廷 Recitation By request
TA 陳韋霖 HW 1 R524
TA 林子瀚 HW 1 R524
TA 周敦翔 HW 2 R524
TA 張文毓 HW 2 R524
TA 陳柏衡 HW 3 R524
TA 高長聖 HW 3 R524
TA 黃兆緯 Project R524