40719 Deep Learning

Course Description

The course helps to understand the fundamentals of Deep Learning. The course starts off gradually with multi-layer preceptrons and it progresses into the more complicated concepts such as attention and sequence-to-sequence models. This course also covers other models of deep learning such as convolutional neural networks, recurrent neural networks, deep generative models such as autoregressive, GAN, VAE, NFM, representation learning, and deep reinforcement learning methods. We use frameworks such as PyTorch and Tensorflow, which are very important for implementing deep Learning models.

Course Information

• Instructor: Hamid Beigy

• Teaching Assistants: Fariba Lotfi,

• Time and Location: Saturday/Monday: 10:30 am -12:30 am, virtual class

• Contact: Please contact the teaching staffs on Piazza site.

Required Texts

1. [GYC] Ian Goodfellow and Yoshua Bengio and Aaron Courville, Deep Learning, MIT Press, 2016.

2. [DY] Li Deng and Dong Yu, Foundations and Trends in Signal Processing, Vol. 7, No. 3–4, pp 197-387, 2014.

3. [SB] Richard S. Sutton and Andrew G. Barto, Reinforcement Learning: An Introduction, Second edition. The MIT Press, 2018.

Grading Policy

1. 20%: Mid-term exam (1400/09/24).

2. 25%: Final exam (1400/11/04).

3. 35%: Homeworks.

4. 15%: Quiz.

5. 5%: Paper & Explore a theoretical or empirical question and present it. Deadline for choosing paper: 1400/09/24.

Lecture Schedule