This novel framework, recently published in IEEE Transactions on Systems, Man and Cybernetics: Systems, could significantly impact the future of smart energy grids, traffic networks and autonomous vehicle systems – technologies that are becoming increasingly central to daily life.
In many real-world systems, decisions don’t happen simultaneously or equally. A utility company might decide when to cut power during peak hours, and households must adjust their energy use in response. In traffic systems, central controllers dictate signals while vehicles adapt accordingly.
“These types of systems operate under a power hierarchy, where one player makes the first move and others must follow, and they’re more complicated than typical AI models assume,” said Zhen Ni, Ph.D., senior author, IEEE senior member and an associate professor in the Department of Electrical Engineering and Computer Science. “Traditional AI methods often treat every decision-maker as equal, operating at the same time with the same level of influence. While this makes for clean simulations, it doesn’t reflect how decisions are actually made in real-world scenarios – especially in environments full of uncertainty, limited bandwidth and uneven access to information.”
To address this, Ni and Xiangnan Zhong, Ph.D., first author, IEEE member and an associate professor in the Department of Electrical Engineering and Computer Science, designed a new AI framework based on reinforcement learning, a technique that allows intelligent agents to learn from interacting with their environment over time.
Their approach adds two key innovations. First, it structures the decision-making process using a game theory model called the Stackelberg-Nash game, where a “leader” agent acts first and “follower” agents respond in an optimal way. This hierarchy better mirrors systems like energy management, connected transportation and autonomous driving. Second, the researchers introduced an event-triggered mechanism that reduces the computational burden.
“Instead of constantly updating decisions at every time step, which is typical of many AI systems, our method updates decisions only when necessary, saving energy and processing power while maintaining performance and stability,” said Zhong.
The result is a system that not only handles the power asymmetry between decision-makers but also deals with mismatched uncertainties – cases where different players operate with varying levels of information and predictability. This is especially critical in environments like smart grids or traffic control systems, where conditions change rapidly and resources are often limited. The framework allows for a more robust, adaptive and scalable form of AI control that can make better use of limited bandwidth and computing resources.
“This work fills a crucial gap in the current AI landscape. By developing a method that reflects real-world decision hierarchies and adapts to imperfect information, Professors Zhong and Ni are helping us move closer to practical, intelligent systems that can handle the complexity of our modern infrastructure,” said Stella Batalama, Ph.D., dean of the College of Engineering and Computer Science. “The implications of this research are far-reaching. Whether it’s optimizing power consumption across cities or making autonomous systems more reliable, this kind of innovation is foundational to the future of intelligent technology. It represents a step forward not just for AI research, but for the everyday systems we depend on.”
Backed by rigorous theoretical analysis and validated through simulation studies, Zhong and Ni demonstrated that their event-triggered reinforcement learning method maintains system stability, ensures optimal strategy outcomes and effectively reduces unnecessary computation. The approach combines deep control theory with practical machine learning, offering a compelling path forward for intelligent control in asymmetric, uncertain environments. Two related journal articles have recently been published on IEEE Transactions on Artificial Intelligence as well. The research work is mainly supported by the National Science Foundation and the United States Department of Transportation.
The research team is now working on expanding their model for larger-scale testing in real-world scenarios. Their long-term vision is to integrate this AI framework into operational systems that power cities, manage traffic and coordinate fleets of autonomous machines – bringing the promise of smarter infrastructure one step closer to reality.
- FAU -
About FAU’s College of Engineering and Computer Science:
The FAU College of Engineering and Computer Science is internationally recognized for innovative research and education in the areas of computer science and artificial intelligence (AI), computer engineering, electrical engineering, biomedical engineering, civil, environmental, and geomatics engineering, mechanical engineering, and ocean engineering. Research conducted by the faculty and their teams exposes students to technology innovations that push the current state-of-the-art of the disciplines. The College's research efforts are supported by the National Science Foundation (NSF), the National Institutes of Health (NIH), the Department of Defense (DOD), the Department of Transportation (DOT), the Department of Education (DOE), the State of Florida, and industry. The FAU College of Engineering and Computer Science offers degrees with a modern twist that bear specializations in areas of national priority such as AI, cybersecurity, internet-of-things, transportation and supply chain management, and data science. New degree programs include Master of Science in AI (first in Florida), Master of Science and Bachelor in Data Science and Analytics, and the new Professional Master of Science and Ph.D. in computer science for working professionals. For more information about the College, please visit eng.fau.edu.
About Florida Atlantic University:
Florida Atlantic University serves more than 32,000 undergraduate and graduate students across six campuses located along the Southeast Florida coast. It is one of only 21 institutions in the country designated by the Carnegie Classification of Institutions of Higher Education as an “R1: Very High Research Spending and Doctorate Production” university and an “Opportunity College and University” for providing greater access to higher education as well as higher earnings for students after graduation. In 2025, Florida Atlantic was nationally recognized as a Top 25 Best-In-Class College and as “one of the country’s most effective engines of upward mobility” by Washington Monthly magazine. Increasingly a first-choice university for students in both Florida and across the nation, Florida Atlantic welcomed its most academically competitive incoming class in the university’s history in Fall 2025. For more information, visit www.fau.edu.
END