This course will cover the fundamentals of robotics and application of artificial intelligence techniques to robotics. Topics include, but not limited to, probabilistic inference, learning theory, modeling development, perception, planning, and search algorithms, localization, tracking and basic control, and programming the robotic system. These techniques will be simulated in a programming infrastructure, the Robot Operating System (ROS), which enables efficient integration of independently developed subsystems into a single system, enabling autonomous robot operation. ROS offers an environment for developing modular control software, a communication infrastructure to connect the software components and an open source library of implemented algorithms. In the scope of this course, we shall cover the practical development of software modules in the ROS environment and integrate the techniques in artificial intelligence into a completely functional system for robot control.
- Instructor: Pei-Chi Huang
- Email: phuang at unomaha dot edu
- Date: January 11, 2021 - May 6, 2021
- Office Hour: Wednesday 7:15PM - 8:15 PM via Zoom or by appointment
- Class Info: MW 6:00PM - 7:15PM, Remote Learning
- Course Schedule
CSCI 3320 Data Structures AND any course equivalent to this course. CSCI 4500 Operating Systems AND any course equivalent to this course. CSCI 4450 Introduction to Artificial Intelligence AND any course equivalent to this course. Basic Python or C++ programming knowledge are recommended. You can take these courses in the same semester. However, if you have not taken these courses before or any concern, you will need to contact the instructor of the course for approval.
Suggested preparatory courses:
Math/STAT 4450/8456 Introduction to Machine Learning and Data Mining; Knowledge of Python and C++, and familiar with Linux operating system , and GitHub for version control.
- Robot Operating System (ROS) website
- Joseph, L. (2018). Learning Robotics using Python: Design, simulate, program, and prototype an autonomous mobile robot using ROS, OpenCV, PCL, and Python. Packt Publishing Ltd. This will be used as a reference, rather than as a textbook, but we will use quite a few methods from it, and it is a valuable addition to your professional library.
- Martinez, Aaron, and Enrique Fernández. Learning ROS for robotics programming. Packt Publishing Ltd, 2013.
- Quigley, M., Gerkey, B., & Smart, W. D. (2015). Programming Robots with ROS: a practical introduction to the Robot Operating System. “ O’Reilly Media, Inc.”.
- Corke, P. (2017). Robotics, vision and control: fundamental algorithms in MATLAB® second, completely revised (Vol. 118). Springer.
Get Odin account
You need to apply for an account at Odin: IS&T Core Linux Server to download our programming assignments. More details are shown below: https://www.unomaha.edu/college-of-information-science-and-technology/about/odin.php. Please email to UNO IST support (Email: uno-ist-support at unomaha dot edu) if you have any questions about Odin. **Please get one asap. Don’t wait until the last-minute, always finish ahead of deadlines. **
There will be 3 programming assignments, one group project. The final course grade will be computed as follows:
- Programming Assignments: 50%
- Group Project: 20%
- Group Report and Presentation: 30%
- Canvas Discussion/Class Participation: ~5%
If you have questions regarding the grading of programming assignments, group project and report and presentation, you MUST email or come to see the instructor WITHIN ONE WEEK after the date your assignments have been returned to you.
Letter grades will be determined using the weighted average of the various items used to evaluate students. A typical grade mapping is illustrated below.
|97 – 100%||A+|
|93 – 96%||A|
|90 – 92%||A-|
|87 – 89%||B+|
|83 – 86%||B|
|80 – 82%||B-|
|77 – 79%||C+|
|73 – 76%||C|
|70 – 72%||C-|
|67 – 69%||D+|
|63 – 66%||D|
|60 – 62%||D-|
|0 – 59%||F|
Programming Assignments and Projects are subject to late penalty. Here is the point deduction policy: 20% deduction (late by 1 day), 40% deduction (late by 2days), 80% deduction (late by 3 days), and no credit if late by more than three days.
Contact the instructor in case of medical emergency, and a written proof from your doctor is required. You are allowed to extend one more day after the approval.
You may discuss the homeworks and assignments with anyone and use any reference materials, but provided you do not copy any other person’s work. We will follow the University Policy on Academic Integrity regarding any cheating and plagiarism. Take the time to familiarize yourself with the contents of this page, as you are responsible for its contents.
Reasonable accommodations are provided for students who are registered with Accessibility Services Center (ASC) and make their requests sufficiently in advance. For more information, contact ASC (Location: 104 H&K, Phone: 402.554.2872, Email: firstname.lastname@example.org
This schedule, and the links contained in it, are subject to change during the semester.
|Mon||Jan. 11||Introduction & Themes||Reading: Building Machines That Learn and Think Like People, Brenden M. Lake, Tomer D. Ullman, Joshua B. Tenenbaum, Samuel J. Gershman (2016)|
|Wed||Jan. 13||Robot Mechanisms||Reading: Robot Mechanisms|
|Mon||Jan. 18||Martin Luther King Day (Student Holiday) - No class|
|Wed||Jan. 20||Robot Mechanisms||Reading: Ch1|
|Mon||Jan. 25||SEVERE WEATHER (No Class)|
|Wed||Jan. 27||Getting_Started_with_ROS||Project Announcement |
Reading: Simulation and Numerical Methods
|Mon||Feb. 1||Getting_Started_with_PyBullet||Reading: ch2 |
Program 1 Available
|Wed||Feb. 3||Robot Simulation||Reading: ch3 |
Project Proposal (the title, project description, motivation, the references) (1 page submission each team)
|Mon||Feb. 8||Introduction to ROS I||Reading: Ch4, Core ROS Tutorials: Beginner Level|
|Wed||Feb. 10||Introduction to ROS II||Core ROS Tutorials: Beginner Level|
|Mon||Feb. 15||Introduction to ROS II||Core ROS Tutorials: Beginner Level|
|Wed||Feb. 17||Introduction to ROS III||Core ROS Tutorials: Beginner Level|
|Mon||Feb. 22||Introduction to ROS III||Reading: ch4 |
|Wed||Feb. 24||Sensing and Perception in Simulation||Reading: ch4 |
Program 1 Due, 11:59pm
|Mon||March 1||Sensing and Perception in Simulation|| Project Milestone (1 page submission each team) |
Program 2 Available
|Wed||March 3||Sensing and Perception in Simulation||Reading: ch5, Gazebo Tutorials Intermediate|
|Mon||March 8||Sensing and Perception in Simulation II||Reading: ch5, Gazebo Tutorials Intermediate|
|Wed||March 10||Sensing and Perception in Simulation II||Reading: Gazebo Tutorials Intermediate, URDF Tutorials|
|Mon||March 15||Spring Vacation (Student Holiday) - No class|
|Wed||March 17||Spring Vacation (Student Holiday) - No class|
|Mon||March 22||Sensing and Perception in Simulation II||Reading: URDF Tutorials, Using a URDF in Gazebo|
|Wed||March 24||Plan Planning: Representation and Fundamentals||Reading: ch8|
|Mon||March 29||Plan Planning: Representation and Fundamentals||Program 2 Due at 11:59pm|
|Wed||March 31||Auto-Navigation Planner||Reading: Ch.8, ROS Navigation Tutorials |
Program 3 Available
|Mon||Apr. 5||Auto-Navigation Planner||Reading: Ch.7 |
Project Checkpoint (1 page submission each team)
|Wed||Apr. 7||OpenCV + ROS||Reading: OpenCV tutorials|
|Mon||Apr. 12||Learning-Based Robotics & Reinforcement learning||Reading: Reinforcement Learning in Robotics: A Survey. Jens Kober, J. Andrew Bagnell, Jan Peters (2013), Recent Advances in Robot Learning from Demonstration. Harish Ravichandar, Athanasios S. Polydoros, Sonia Chernova, Aude Billard (2020)|
|Wed||Apr. 14||Learning-Based Robotics & Reinforcement learning||Reading: Soft Actor-Critic Algorithms and Applications. Tuomas Haarnoja, Aurick Zhou, Kristian Hartikainen, George Tucker, Sehoon Ha, Jie Tan, Vikash Kumar, Henry Zhu, Abhishek Gupta, Pieter Abbeel, Sergey Levine (2018), Continuous Control with Deep Reinforcement Learning. Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, Daan Wierstra (2015)|
|Mon||Apr. 19||Presentation (Team 1-4)|
|Wed||Apr. 21||Presentation (Team 5-8)|
|Mon||Apr. 26||Prep week - No class|
|Wed||Apr. 28||Prep week - No class||Program 3 Due at 11:59pm|
|Sun||May 2||Report and Demo Due (TBD)||Report Template |
Report and Demo Due 11:59pm
Submission: 1) A report, 2) Presentation slides, and 3) Demo video.