Control Seminar

Learning and Control for Safety, Efficiency, and Resiliency of Embodied AI

Fei MiaoAssociate Professor, School of ComputingUniversity of Connecticut
1500 EECS BuildingMap

Abstract: With rapid evolution of sensing, communication, and computation, integrating learning and control presents significant Embodied AI opportunities. However, current decision-making frameworks lack comprehensive understanding of the tridirectional relationship among communication, learning and control, posing challenges for multi-agent systems in complex environments. In the first part of the talk, we focus on learning and control with communication capabilities. We design an uncertainty quantification method for collaborative perception in connected autonomous vehicles (CAVs). Our findings demonstrate that communication among multiple agents can enhance object detection accuracy and reduce uncertainty. Building upon this, we develop a safe and scalable deep multi-agent reinforcement learning (MARL) framework that leverages shared information among agents to improve system safety and efficiency. We validate the benefits of communication in MARL, particularly in the context of CAVs in challenging mixed traffic scenarios. We incentivize agents to communicate and coordinate with a novel reward reallocation scheme based on Shapley value for MARL. Additionally, we present our theoretical analysis of robust MARL methods under state uncertainties, such as uncertainty quantification in the perception modules or worst-case adversarial state perturbations. In the second part of the talk, we briefly outline our research contributions on robust MARL and data- driven robust optimization for sustainable mobility. We also highlight our research results concerning CPS security. Through our findings, we aim to advance Embodied AI and CPS for safety, efficiency, and resiliency in dynamic environments.

Biography: Fei Miao is Pratt & Whitney Associate Professor of the School of Computing, a Courtesy Faculty of the Department of Electrical & Computer Engineering, University of Connecticut, where she joined in 2017. She is affiliated to the Institute of Advanced Systems Engineering and Eversource Energy Center. She was a postdoc researcher at the GRASP Lab and the PRECISE Lab of Upenn from 2016 to 2017. She received Ph.D. degree and the Best Doctoral Dissertation Award in Electrical and Systems Engineering, with a dual M.S. degree in Statistics from the University of Pennsylvania in 2016. She received the B.S. degree in Automation from Shanghai Jiao Tong University in 2010. Her research focuses on multi-agent reinforcement learning, robust optimization, uncertainty quantification, and game theory, to address safety, efficiency, robustness, and security challenges of Embodied AI and CPS, for systems such as connected autonomous vehicles, sustainable and intelligent transportation systems, and smart cities. Dr. Miao is a receipt of the NSF CAREER award and a couple of other awards from NSF. She received the Best Paper Award and Best Paper Award Finalist at the 12 th and 6 th ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) in 2021 and 2015, Best paper Award at the 2023 AAAI DACC workshop, respectively.

***Event will take place in hybrid format. The location for in-person attendance will be room 1500 EECS.   Attendance will also be possible via Zoom. The Zoom link and password will be distributed to the Controls Group e-mail list-serv.

To join this list-serv, please send an (empty) email message to [email protected] with the word “subscribe” in the subject line. To cancel your subscription, send an (empty) email to  [email protected] with the word “unsubscribe” in the subject line.  Zoom information is also available upon request to Shelly Feldkamp at [email protected].

See full seminar by Professor Miao

Faculty Host

Vasileios TzoumasAssistant Professor, Aerospace EngineeringUniversity of Michigan, College of Engineering