16-350 Planning Techniques for Robotics

Planning is one of the core components that enable robots to be autonomous. Robot planning is responsible for deciding in real-time what the robot should do next, how to do it, where the robot should move next and how to move there. This class does an in-depth study of popular planning techniques in robotics and examines their use in ground and aerial robots, humanoids, mobile manipulation platforms and multi-robot systems. The students learn the theory of these methods and also implement them in a series of programming-based projects.

To take the class students should have a good knowledge of programming and data structures.

Spring 2024 Course Information

Announcements

Dates/times

Class meetings:

Mondays, Wednesdays, 2:00-3:20PM, NSH 3002

Instructor

Who	Email
Maxim Likhachev

Teaching Assistants

Who	Email
Itamar Mishani
Siddharth Saha

Office Hours

Who	Location	Hours
Itamar	NSH 4513	Mon 3:30-4:30PM
Saha	NSH A507	Wed 5:30-6:30PM
Maxim	NSH 3211	By appointment

Grading

The criteria used to compute the final grade will consist of a combination of scores obtained on the exam, three programming assignments (homeworks), pop quizzes, final project and class participation:

Three homeworks	33%
Exam	20%
In-class pop quizzes	10%
Final project	32%
Participation	5%

Each student has a total of 3 free late days that may be used as needed for homeworks. No late days may be used for the final project!
Additional details: A late day is defined as a 24-hour period after the deadline. After the free late days are used up, each additional late day will incur a 10% penalty on the maximum achievable score with an upper limit on the penalty of 50%. For example, if the assignment is worth 100 points and you score is 80, then you actual score will be 72 if you have 1 additional late day, 64 if you have 2 additional late days, etc.

Class lectures/notes:

Tentative schedule for the class (PDF)

Date	Topic	Slides	Homeworks	Additional Info
1/17 (Wed)	Introduction, What is Robot Planning?	slides	-	-
1/22 (Mon)	Planning Representations: Skeleton-, Grid- and Lattice-based Graphs, Explicit vs. Implicit Graphs	slides	-	-
1/24 (Wed)	*Search Algorithms: Uninformed A Search**	slides	Robot Chasing Target Planning HW1	-
1/28 (Mon)	Search Algorithms: A* Search, Multi-goal A*	slides	-	-
1/31 (Wed)	*Search Algorithms: Heuristics, Backward A, Weighted A* Search**	slides	-	-
2/5 (Mon)	Interleaving Planning and Execution: Anytime Heuristic Search	slides	-	-
2/8 (Wed)	Interleaving Planning and Execution: Incremental Heuristic Search	slides	-	-
2/12 (Mon)	Interleaving Planning and Execution: Incremental Heuristic Search (cont'd)	-	-	-
2/15 (Wed)	Interleaving Planning and Execution: Real-time Heuristic Search	slides	-	-
2/19 (Mon)	Case Study: Planning for Autonomous Driving	slides	-	-
2/21 (Wed)	Planning Representations: Probabilistic Roadmaps for Continuous Spaces	slides	N-DoF Planar Arm Planning HW2	-
2/26 (Mon)	Planning Representations/Search Algorithms: RRT, RRT-Connect, RRT*	slides	-	-
2/28 (Wed)	*Planning Representations/Search Algorithms: RRT, RRT-Connect, RRT (cont'd)**	-	-	-
3/4 (Mon)	SPRING BREAK: NO CLASSES	-	-	-
3/6 (Wed)	SPRING BREAK: NO CLASSES	-	-	-
3/11 (Mon)	Case Study: Planning for Mobile Manipulators and Articulated Robots	slides	-	-
3/13 (Wed)	Search Algorithms: Markov property, independent vs. dependent variables	slides	-	-
3/18 (Mon)	Case Study: Planning for Coverage, Mapping and Surveyal	slides	-	-
3/20 (Wed)	Presentation of Final Project Proposals	-	-
3/25 (Mon)	Planning Representations: Symbolic Representation for Task Planning	slides	Symbolic Planning HW3	-
3/27 (Wed)	Search Algorithms: Planning on Symbolic Representations	slides	-	-
4/1 (Mon)	Planning under Uncertainty: Minimax Formulation	slides	-	-
4/3 (Wed)	Planning under Uncertainty: Expected Value Formulation	slides	-	-
4/8 (Mon)	Planning under Uncertainty: Solving Markov Decision Processes	slides	-	-
4/10 (Wed)	Exam	-	-	-
4/15 (Mon)	Planning under Uncertainty: Partially-Observable Markov Decision Processes (POMDPs)	slides	-	-
4/17 (Wed)	Multi-Robot Planning	slides	-	-
4/22 (Mon)	Multi-Robot Planning (cont'd)	-	-	-
5/24 (Wed)	Final Project Presentations	-	-	-