Action and Planning in AI: Learning, Models, and Algorithms

Content:

• Models and Solvers in AI
• State models and heuristic search
• Logic, SAT solving, and ASP solving
• Classical planning: language, model, basic algorithms (heuristic search and SAT)
• Markov Decision Processes (MDPs): basic models and algorithms (VI, PI, RTDP, MCTS)
• Deep learning (DL) as model and solver; supervised learning, Approx VI, PI, MPI with DL
• Reinforcement Learning (RL): Value-based and policy gradient methods
• Current research in planning and RL

Seminar: Advanced Topics in Reinforcement Learning and Planning

Description: Students will present papers from a list of important, recent works in machine learning compiled by the professor. Topics include deep and reinforcement learning, and transformer and GNN architectures. The focus will be on the use of these techniques in simple applications that are crisp and easy to understand. The list of papers will also include those underlying well-known learning systems like ChaptGPT, AlphaZero, Gato, etc. The final list of papers and topics to be covered will be defined after the first meeting.