Course Information
Yun-Nung (Vivian) Chen
Virtual (YT Video) / Physical (R103)
Thursday 09:10 - 12:10
National Taiwan University,
Computer Science and Information Engineering
Lectured by Yun-Nung (Vivian) Chen
Yun-Nung (Vivian) Chen
Virtual (YT Video) / Physical (R103)
Thursday 09:10 - 12:10
Date | Lecture | Recitation | Note |
---|---|---|---|
2023/09/07 |
Course Logistics
[ 0]
Introduction [ 1.1] [ 1.2] [ 1.3] |
Dev Infra & Tooling
[ PyTorch] [ Debugging] |
Virtual |
2023/09/14 |
Neural Network Basics
[ 2.1]
[ 2.2]
[ 2.3]
[ 2.4]
Backpropagation [ 2.5] |
Virtual | |
2023/09/21 |
Word Representation
[ 3.1]
Sequence Modeling [ 3.2] [ 3.3] [ 3.4] |
NLP Lifecycle
[ Step by Step] [Colab] |
Physical |
2023/09/28 | Teachers' Day Break | Virtual | |
2023/10/05 |
Attention Mechanism
[ 4.1]
[ 4.2]
Transformer [ 4.3] [ 4.4] [ 4.5] |
Underlying Logics of Projects
[ Step by Step] |
Virtual |
2023/10/12 |
Tokenization
[ 5.1]
BERT [ 5.2] BERT Variants [ 5.3] [ 5.4] [ 5.5] [ 5.6] |
Virtual | |
2023/10/19 |
Dr. Nancy F. Chen Guest Lecture (10:00-11:20) |
Physical HW 2 |
|
2023/10/26 |
NLG Decoding
[ 6.1]
[ 6.2]
[ 6.3]
NLG Evaluation [ 6.4] [ 6.5] |
Virtual | |
2023/11/02 | Midterm Break | ||
彈性補充 |
Reinforcement Learning
[ RL.1]
[ RL.2]
[ RL.3]
Value-Based RL [ RL.4] [ RL.5] [ RL.6] |
自學 | |
彈性補充 | Policy Gradient & Actor-Critic [ RL.7] [ RL.8] | 自學 | |
2023/11/09 |
Prompt-Based Learning
[ 7.1]
[ 7.2]
[ 7.3] [ 7.4] [ 7.5] [ 7.6] [ 7.7] |
LLM Architecture [ Basics] |
Physical HW 3 |
2023/11/16 | LLM Adaptation [ 8.1] [ 8.2] [ 8.3] |
LLM LoRA Training [ LoRA] |
Physical |
2023/11/23 |
Conversational Modeling
[ 9.1]
[ 9.2]
[ 9.3] [ 9.4] [ 9.5] |
Physical |
|
2023/11/27 (Mon) Dr. Shao-Hua Sun |
Guest Lecture (10:00-12:00) Program-Guided Robot Learning |
Physical | |
2023/11/30 | Final Project Description | LLM Inference & Evaluation |
Physical |
2023/12/07 | Break | ||
2023/12/13 (Wed) |
Guest Lecture (14:20-16:00) Cross-Language IR Models |
Physical | |
2023/12/14 |
Beyond Supervised Learning Issues in Pre-Trained Models |
Physical | |
2023/12/21 | Final Project Presentation |
The assignments should be submitted via NTU COOL.
NO LATE SUBMISSION IS ALLOWED!
Please send your questions to adl-ta@csie.ntu.edu.tw.
Please make sure the title of your mail starts with [ADL2023].
Role | Name | Work | Office Hour | Location |
---|---|---|---|---|
Head TA | 林彥廷 | Recitation | By request | |
TA | 陳韋霖 | HW 1 | R524 | |
TA | 林子瀚 | HW 1 | R524 | |
TA | 周敦翔 | HW 2 | R524 | |
TA | 張文毓 | HW 2 | R524 | |
TA | 陳柏衡 | HW 3 | R524 | |
TA | 高長聖 | HW 3 | R524 | |
TA | 黃兆緯 | Project | R524 |