Department of Computer Science , University of British Columbia

CPSC 422: Intelligent Systems 

Winter Session 2009/2010 Term 2

SCHEDULE

January February March April

This schedule is subject to change. Please make sure  to check it  regularly, because here is where relevant material for each class (e.g., PDF lecture slides) and all the assignments  will be posted. However, the textbook chapters from the additional reference book (Artificial Intelligence: Foundations of Computational Agents, by Pool and Mackworth) are only available through WebCT.   

Assignment due dates are provided to give you a rough sense; however, they are also subject to change.

I'll  post each lecture's slides right after class.  I won't post  additional material  that I write on the slides or on the board during class. You'll have to come to class to get that).

All the listed readings should be completed before class. Unless noted otherwise, all readings refer to the course textbook: Artificial IntelligenceA Modern Appropach. The additional reference, Artificial Intelligence: Foundations of Computational Agents, by Pool and Mackworth will be indicated as "P&M" when mentioned in the readings


January
Tuesday Thursday

5   Introduction            

       Slides

      

  

 

 

                                                                                                          #1

Review of Bayesian networks

    Slides

  • Make sure that you understand  the basics of Probability Theory. We won't cover them in class, but see  Ch. 13 of  the textbook and these slides for a review.

  • Readings: textbook sections 14.1 to 14.3 (up to page 519)

#2

12  Approximate Inference in Bayesian networks (background)

    Slides

  • Readings: textbook sections 14.5.1

  • Additional References: section 6.4.2 in P&M , up to page 260

                                                                                        #3

14  Approximate Inference in Bayesian Networks (Algorithms)

       Slides

 

 

 

 

#4

19  Using Bayesian Networks - Case Study: The Andes Tutoring System

Slides

Instructions to run and use Andes

 

In this class, we will discuss the following paper:

Conati C., Gertner A., VanLehn K., 2002. Using Bayesian Networks to Manage Uncertainty in Student Modeling. User Modeling and User-Adapted Interaction. 12(4) p. 371-417.

Make sure to have at least two questions on this  reading to  discuss  in class. 

Please email  your questions (with subject "questions for 422") to both

conati@cs.ubc.ca, hajir@cs.ubc.ca, by 9am today. Also bring a paper copy of your questions to handin in class.

 

     

 

#5 

21 Probability and time: probabilistic temporal models,  algorithms

Slides

  • Readings: textbook sections: 15.1-15.3; 15.5

 

Assignment 1

hmw1.zip

#6 

26  Probability and time: Algorithms (cont'd), Hidden Markov Models

Slides 

 

 

#7 

28  Probability and time:  PoS tagging, Dynamic Bayesian Networks, Particle Filtering

 

Slides

#8 

 

February

Tuesday Thursday
2 Decision theoretic planning: Intro and MDPs

Slides

  • Readings: textbook sections 17.1 to 17.3

#9 

 4 Decision theoretic planning: Value Iteration and Policy Iteration

Slides

Assignment 1 due Friday Feb 5


Assignment 2 due Wednesday March 3

 

CpGislands.zip

observations.txt

exact_probs.txt

#10

9 Decision theoretic planning: POMDPs

Slides

  • Readings: textbook sections 17.4 (17.4.2 excluded)

To review background concepts covered in 322  see:    

  • Ch 16  in texbook;

  • 9.1-9.4 in P&M

#11

 11 Learning: Introduction, Supervised Learning, Decision Trees

slides

  • Readings: textbook sections  18.1-18.3 (technical details in 18.3.5 are not required)

 

 

 

 

#12


Reading Week  + Olympic Break

Reading Week  + Olympic Break Olympic Break

March

Tuesday Thursday
2  Lecture by Pooja Viswanathan on applications of POMDPs in assistive technology

slides

See http://www.cs.uwaterloo.ca/~ppoupart/software.html for code and sample problems for Symbolic Perseus algorithm for factored POMDPs

 

 

 

4 Learning: Decision Trees

slides

 

 

9  Learning: Neural Networks

slides

  • Readings: textbook section 18.6.3, 18.6.4, 18.7  (technical details  on back propagation in 18.7.4 are not required)

#15

 11  Midterm (click here to see what you need to know for it)

Practice exercise on DT learning

Assignment 3 due Thursday March 25,11pm

 

single_datapoint_w1.xml

two_datapoints_w0.xml

 

 

 

#16

16  Statistical learning, Learning Bayesian networks  with complete data 

Slides

  • Readings: textbook sections:  20.1, 20.2.1, 20.2.2 

 

 

#17

18  Learning Bayesian Networks  with hidden variables

Slides

  • Readings: textbook:  20.3, 20.3.2 (no 20.3.1)

#18

23   Reinforcement Learning: Q-learning

Slides (cover also lecture of March 25)

#19

25   Reinforcement Learning: Q-learning

Slides

  • Readings: section 11.3.4 11.3.5, 11.3.6   of P&M RL chapter

#20

30 Reinforcement learning: exploration/exploitation, off policy methods

slides

Assignment 4

due Tuesday April 13, midnight

 

#21

 

#22


 
April

Tuesday
Thursday
  1  Ontologies and knowledge-based systems

slides

#22

6 No Class

 

8 The Semantic Web

slides

#23

13 Adaptive User Interfaces (readings based class)
 

slides

Make sure to have at least two questions on this  reading to  discuss  in class.  Please email  your questions (with subject "questions for 422") to both

conati@cs.ubc.ca, hajir@cs.ubc.ca, by 9am today.

 

Also bring a paper copy of your questions to handin in class.

Reference paper: A. Jameson. "Adaptive Interfaces and Agents" in J. A. Jacko, & A. Sears (Eds.) (2007). Human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications (2nd ed.). Mahwah, NJ: Erlbaum

 

Assignment 4 due (@midnight)

#24

15Adaptive support for interface usage (readings based class)

Make sure to have at least one question on the reading to  discuss  in class. 

Please email  your questions (with subject "questions for 422") to both

conati@cs.ubc.ca, hajir@cs.ubc.ca, by 9am today,



Sidney K. D'Mello, Arthur C. Graesser: (2007) Mind and Body: Dialogue and Posture for Affect Detection in Learning Environments. AIED 2007: 161-168

Be prepared to discuss the Jameson's paper, which we didn't get to cover on Tu.


 




20 22

27  FINAL EXAM,   8:30 am , DMP 301  

NOTE: you will be allowed to bring  into the exam a letter sized sheet of paper with anything written on it (double sided). You may not use calculators, PDAs, robotic assistants or other electronic aids.

Practice Problems

Cristina's office hours for the period before the exam are

Fri, April 23, 2--3:30

Mon, April 26, 1-2:30

or send me email if you need to make special arrangements

1