This is the course webpage for the Spring 2019 version of TTIC 31210: Advanced Natural Language Processing.
For the Spring 2017 course, go here
Room 526 (fifth floor), TTIC
Instructor: Kevin Gimpel
Instructor Office Hours:
Mondays 2:50-3:15pm, Wednesdays 2:50-4pm, Room 531
Teaching Assistant: Mingda Chen
Teaching Assistant Office Hours:
Mondays 3-4pm, TTIC Library (fourth floor)
or permission of the instructor.
All textbooks are optional. We will post optional readings from the following texts to accompany lecture slides.
: Daniel Jurafsky and James H. Martin. Speech and Language Processing (2nd Edition). Pearson: Prentice Hall. 2009.
: Drafts of some chapters of the 3rd edition are freely available online
: Yoav Goldberg. Neural Network Methods for Natural Language Processing. 2017.
Two copies are on reserve in the TTIC library. An earlier draft is freely available online
: Shay Cohen. Bayesian Analysis in Natural Language Processing. 2016.
5 assignments (15% each)
class participation, including in-class handouts and quizzes (25%)
- Introduction and Brief Review of TTIC 31190 (1 lecture)
- Deep Learning for NLP (5 lectures): similarity functions, loss functions, contextualized word embeddings, subword units, sequence-to-sequence models, attention, self-attention, neural machine translation, other applications
- Structured Prediction in NLP (4 lectures): sequence labeling, syntactic and semantic parsing, dynamic programming
- Generative Modeling (2 lectures): generative models, latent variables, unsupervised learning, variational autoencoders
- Bayesian NLP (2 lectures): priors, Bayesian inference, topic modeling, Gibbs sampling
- Bayesian Nonparametrics in NLP (2 lectures)
- Review and Other Topics (1 lecture)
You are welcome to discuss assignments with others in the course, but solutions and code must be written individually.
If you turn in an assignment late, a penalty will be assessed.
The penalty will be 2% (of the entire point total) per hour late.
You will have 4 late days to use as you wish during the quarter. Late days must be used in whole increments (i.e., if you turn in an assignment 6 hours late and want to use a late day to avoid penalty, it will cost an entire late day to do so).