Teaching Summer 2023

• Models and Solvers in AI
• State models and heuristic search
• Logic, SAT solving, and ASP solving
• Classical planning: language, model, basic algorithms (heuristic search and SAT)
• Markov Decision Processes (MDPs): basic models and algorithms (VI, PI, RTDP, MCTS)
• Deep learning (DL) as model and solver; supervised learning, Approx VI, PI, MPI with DL
• Reinforcement Learning (RL): Value-based and policy gradient methods
• Current research in planning and RL

Students will present papers from a list of important recent works in machine learning compiled by the professor. Topics include deep and reinforcement learning, and transformer and GNN architectures. The focus will be in the use of these techniques in simple applications that are crisp and easy to understand. The list of papers will also include those underlying well-known learning systems like as Dalle-E, ChaptGPT, Alphazero, Gato, etc.