CS 590 - Grad AI
2025 - Spring
An introduction to the concepts of artificial intelligence.
Tentative schedule is provided below – assignments dates and lectures will be updated as the course progresses.
Table of contents
- INTRO
- UNIT 1: Search
- UNIT 2: Constraint Satisfaction Problems & Adversarial Search
- UNIT 3: Markov Decision Processes and Reinforcement Learning
- UNIT 4: Probability, Bayesian Networks, and HMMs
- FINAL EXAM
INTRO
UNIT 1: Search
UNIT 2: Constraint Satisfaction Problems & Adversarial Search
| WEEK 9 |
| Spring Break |
UNIT 3: Markov Decision Processes and Reinforcement Learning
| WEEK 10 |
| UNIT 2 EXAM Tue. 3/18 |
| Markov Decision Processes I Videos: Lec 8 |
| Markov Decision Processes II Videos: [Lec 9](https://siuecougars-my.sharepoint.com/:v:/g/personal/egultep_siue_edu/ERfMUYvOuV5BozJKxNrFW2sBHB7B5eAZo7_C0yGwljmhLg?nav=eyJyZWZlcnJhbEluZm8iOnsicmVmZXJyYWxBcHAiOiJPbmVEcml2ZUZvckJ1c2luZXNzIiwicmVmZXJyYWxBcHBQbGF0Zm9ybSI6IldlYiIsInJlZmVycmFsTW9kZSI6InZpZXciLCJyZWZlcnJhbFZpZXciOiJNeUZpbGVzTGlua0NvcHkifX0&e=XT9QAj |
| Notes - Markov Decision Process |
| Worksheet 4 - MDPsWorksheet 4 - Solution |
| P3 - Reinforcement Learning(Due: Tue. 4/8)HW3 - RL(Due: Tue. 4/8) |
| WEEK 11 |
| Reinforcement Learning I Videos: Lec 10 |
| Reinforcement Learning II Videos: Lec 11 |
| Notes - Reinforcement Learning |
| Worksheet 5 - RLWorksheet 5 - Solution |
| WEEK 12 |
| Exam Prep - MDPsExam Prep - MDP SOLN |
| Exam Prep - RLExam Prep - RL SOLN |
| WEEK 13 |
| Review Questions - MDPReview Questions - MDP SOLN |
| Review Questions - RLReview Questions - RL SOLN |
UNIT 4: Probability, Bayesian Networks, and HMMs
FINAL EXAM
| WEEK 17 |
| UNIT 4 EXAM Wed., May 7, 2025, 2 - 3:40pm, EB 2170 |