MSU leads Office of Naval Research grant to make AI more reliable and transparent

(Press-News.org) Highlights:

Michigan State University researchers are leading a $1.8 million grant project funded by the Office of Naval Research to evolve artificial intelligence. The research would make it possible to use AI more reliably for tasks we already accomplish with help from popular AI tools like ChatGPT. It could also enable people to entrust AI systems with more advanced jobs that rely on understanding language and visual information, including education, navigation and multimodal question-answering systems. The team is working to connect “classical” or symbolic AI with current deep neural networks and create a neuro-symbolic framework. This combined approach would create systems that have both a vast wealth of learning from data and explicit reasoning capabilities. EAST LANSING, Mich. – Artificial intelligence has entered the mainstream in a way the world has never experienced before. Millions of people are using tools such as ChatGPT and Stable Diffusion for AI-generated help answering questions, creating images and accomplishing a host of other tasks.

But anyone who has used these systems has probably also noticed these tools have limitations. They can, for example, overlook a key component of a request or come up with something that’s not quite right.

“Every day, these AI models impress us, but we’re still not sure how trustworthy and reliable they are,” said Parisa Kordjamshidi, an assistant professor in the Department of Computer Science and Engineering at Michigan State University.

“Even when they provide the right answer, they might be right for the wrong reasons.  We need to know what is their line of reasoning,” Kordjamshidi said. “That’s not very clear right now, and that’s the challenge.”

The Office of Naval Research has awarded Kordjamshidi and her colleagues a $1.8 million grant to make our interactions with AI more reasonable and reliable. This would bolster the confidence people have in using AI tools that are increasingly acting as digital assistants. But the team also has larger goals.

The researchers are working to help AI better process a range of inputs — text, images and video — to make human interactions with computer systems more powerful and seamless. The project could thus enable advances in a variety of applications, Kordjamshidi said, including education, navigation and multimodal question-answering systems in general.

This represents one of the major research thrusts for Kordjamshidi’s team. In fact, she won a 2019 National Science Foundation Faculty Early Career Development Award and a 2021 Amazon Research Award on this front. Her team is working to help AI understand natural, everyday human language — rather than computer code — and put that understanding to work in following human instructions for navigating a realistic environment.

“We want to be able to connect this to the real world, to physical environments,” Kordjamshidi said. “Even if an AI system is 70% reliable, that wouldn’t be high enough for many serious real-world applications.”

While Kordjamshidi’s primary expertise is on the natural language component of AI, she’s teamed up with other AI innovators with complementary skills on this grant. At MSU, that includes Yu Kong and Vishnu Boddeti, both assistant professors in the College of Engineering. Dan Roth, a professor at the University of Pennsylvania, is also a co-investigator.

“This is a very collaborative project,” Kordjamshidi said. “We’re bringing together experts from various areas of learning and reasoning over vision and language data.”

Make new algorithms, but keep the old

The core of the team’s idea is to combine modern algorithms with an earlier approach to AI that started rising to prominence in the 1980s. Now known as classical or symbolic AI, these algorithms worked to teach computer systems explicit forms of reasoning and logic.

But symbolic AI systems could not scale up with real-world complexity and weren’t robust enough to handle noisy or incomplete information, Kordjamshidi said. As classical AI failed to live up to its early hype, interest waned.

On the other hand, early neural models also struggled with scaling to real-world complexity because they lacked the requisite data and computational power. But those obstacles have become surmountable with the current availability of data and new technology capable of handling the necessary computations.

Today’s neural network algorithms can be trained using massive data sets to recognize billions of parameters within text, images and videos. Researchers are still improving these algorithms by feeding them more data and using more parameters, which has enabled the success of platforms like ChatGPT.

The MSU-led research team, however, sees limits to this approach.

“I don’t think we can put all of the world’s information into a system and have it reason and compose new concepts like a human,” Kordjamshidi said. “Adding more data into larger and larger models has been the approach — and it has been a game-changer — but if we want to get to the next level of AI, I think we need to combine paradigms.”

“Neural networks are very good at learning in a black-box way, but they’re not good at reasoning like humans,” Kong said.

Neural networks do have some implicit reasoning capabilities, but those are essentially inferred from the data they see rather than conferred by human programmers, he said.

Incorporating symbolic AI would build in explicit reasoning, which would bolster AI’s ability to understand things like temporal and spatial relationships that humans handle almost innately.

“People have tried to do this a few times in the past, but I think it wasn’t quite the right time and they didn’t have the right tools,” Boddeti said. “I think we’re in the right time now.”

By Matt Davenport

on MSUToday

###

Michigan State University has been advancing the common good with uncommon will for more than 165 years. One of the world's leading research universities, MSU pushes the boundaries of discovery to make a better, safer, healthier world for all while providing life-changing opportunities to a diverse and inclusive academic community through more than 400 programs of study in 17 degree-granting colleges.

For MSU news on the Web, go to MSUToday. Follow MSU News on Twitter at twitter.com/MSUnews.

END