Event

Special Seminar: Kyriakos Vamvoudakis, Bounded Rational Intell. & Metalearning in Auton. Systems

Monday, June 12, 2023
11:00 a.m.
2460 AV Williams Bldg and on Zoom
Edna Walker
ednaw@umd.edu

Bounded Rational Intelligence and Metalearning in Autonomous Systems

Kyriakos G. Vamvoudakis
Dutton-Ducoffe Endowed Professor
The Daniel Guggenheim School of Aerospace Engineering
Georgia Institute of Technology

Abstract
Autonomous systems will be tasked with operating in complex, human-centric environments both in cooperation and in competition with humans and other agents. In this talk, issues of prediction in the context of game theory and multi-agent cyber-physical systems will be addressed. To account for the cognitive limitations of human and machine decision-makers, we introduce ideas and principles of bounded rationality for autonomy using tools from control theory and reinforcement learning. Specifically, we will formulate level-k thinking and cognitive hierarchy models in nonlinear and linear noncooperative differential games, where each agent is assigned an intelligence level corresponding to a number of thinking iterations. The applicability of this approach will be highlighted via the example of a pursuit evasion game between Unmanned Aerial Vehicles. The versatility of the proposed methods will be shown via results of level-k thinking in discrete stochastic games. Finally, to design more advanced decision-making algorithms that explicitly exploit the learning abilities of the other agents in the environment, a meta-learning framework in games will be presented, via which an autonomous agent can achieve learning manipulation and deception.

About the speaker
Kyriakos G. Vamvoudakis was born in Athens, Greece. He received the Diploma (a 5 year degree, equivalent to a Master of Science) in Electronic and Computer Engineering from the Technical University of Crete, Greece in 2006 with highest honors. After moving to the United States of America, he studied at The University of Texas at Arlington with Frank L. Lewis as his advisor and he received his M.S. and Ph.D. in Electrical Engineering in 2008 and 2011 respectively. From May 2011 to January 2012, he was working as an Adjunct Professor and Faculty Research Associate at the University of Texas at Arlington and at the Automation and Robotics Research Institute. During the period from 2012 to 2016 he was a project research scientist at the Center for Control, Dynamical Systems and Computation at the University of California, Santa Barbara.

He was an assistant professor at the Kevin T. Crofton Department of Aerospace and Ocean Engineering at Virginia Tech until 2018. He currently serves as the Dutton-Ducoffe Endowed Professor and Associate Professor at The Daniel Guggenheim School of Aerospace Engineering at Georgia Tech. He holds a secondary appointment in the School of Electrical and Computer Engineering. His research interests include reinforcement learning, control theory, cyber-physical security, bounded rationality, and safe/assured autonomy. Dr.

Vamvoudakis is the recipient of a 2019 ARO YIP award, a 2018 NSF CAREER award, a 2021 GT Chapter Sigma Xi Young Faculty Award, and of several international awards including the 2016 International Neural Network Society Young Investigator (INNS) Award, the Best Paper Award for Autonomous/Unmanned Vehicles at the 27th Army Science Conference in 2010, and the Best Researcher Award from the Automation and Robotics Research Institute in 2011. He has also served on various international program committees and has organized special sessions, workshops, and tutorials for several international conferences.

He currently is a member of the Technical Committee on Intelligent Control of the IEEE Control Systems Society, a member of the Technical Committee on Adaptive Dynamic Programming and Reinforcement Learning of the IEEE Computational Intelligence Society, a member of the IEEE Control Systems Society Conference Editorial Board, an Associate Editor of: Automatica; IEEE Computational Intelligence Magazine; IEEE Transactions on Systems, Man, and Cybernetics: Systems; IEEE Transactions on Artificial Intelligence; Neurocomputing; Journal of Optimization Theory and Applications; IEEE Control Systems Letters; and of Frontiers in Control Engineering-Adaptive, Robust and Fault Tolerant Control. He is also a registered Electrical/Computer engineer (PE), a member of the Technical Chamber of Greece, and a Senior Member of both IEEE and AIAA.

Zoom Link
https://umd.zoom.us/j/94449473570?pwd=YTNMSnhxeSs4MmpIRTEzZjBOcjdZUT09 Meeting ID: 944 4947 3570 Passcode: 264748