PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Transformation of controller software to ensure safe behavior under perceptual uncertainty

Bridging the gap between uncertain perception and reality in controller software design

Transformation of controller software to ensure safe behavior under perceptual uncertainty
2021-07-07
(Press-News.org) A research team consisting of Tsutomu Kobayashi, Ichiro Hasuo, Fuyuki Ishikawa, and Shinya Katsumata at the National Institute of Informatics (NII, Japan) and Rick Salay and Krzysztof Czarnecki at University of Waterloo (Canada) developed a method that automatically transforms models of controller software into models that satisfy safety requirements even when there is uncertainty in sensing the state of the environment. In addition to the transformation, the method generates formulas that represent the degree of uncertainty that the controller software can tolerate. The method can be applied to various controller systems that interact with the external environment, including autonomous vehicles. This research was conducted under the ERATO MMSD Project (*1) funded by the Japan Science and Technology Agency (JST, Japan). The findings were presented at the 13th NASA Formal Methods Symposium (online) on May 26th, 2021.

Background

Controller systems such as drones and autonomous vehicles are vital in society. These systems must be able to function as safely as possible because many of them are intended for use in the real world. Approaches involving mathematical modeling of the systems and verifying their safety are effective for guaranteeing safety. The controller software in such systems determines its actions in response to the state of the environment, which is perceived with sensors. In reality, however, the systems may perceive values that differ from the true values (perceptual uncertainty). This can cause safety violations if the controller software behaves in response to the incorrectly perceived values. For instance, if the sensor of an autonomous vehicle can misperceive the positions of other cars up to 1 m, it should operate with a safety margin of at least 1 m (Figure 1 (a)). Designing such uncertainty-aware and safe controller software is quite complicated because developers need to verify that safety is guaranteed for every possible behavior of the system while taking into consideration differences between true values and perceived values (Figure 1 (b)). In addition, it is difficult to estimate the degree of the uncertainty. For example, perceptual uncertainty depends on the situation in which the controller system is deployed, such as whether or not it is foggy. Therefore, rather than specifying concrete perceptual uncertainty in models, constructing uncertainty-unaware controller models and calculating the degree of uncertainty the constructed controllers can tolerate are more suitable for flexible analysis. However, obtaining this limit as a formula proved to be difficult.

Methods and Results

In this study, we propose a method that automatically transforms a model of an uncertainty-unaware controller into a model of a robustified controller, that is, a new controller that safely behaves even under uncertainty (Figure 2). The method consists of two steps. The first step (uncertainty injection) is to transform an input model of an uncertainty-unaware controller into an intermediate model of an uncertainty-aware controller. Note that the behavior of the intermediate model is the same as that of the input model so it is unsafe. Then the next step (robustification) is to transform the intermediate model into one that is uncertainty-aware and safe. The behavior of the resulting controller is updated so that it operates safely even under uncertainty. In addition, the method generates a formula that represents the degree of uncertainty that the output controller can tolerate. In the first step (uncertainty injection), variables of perceived values, which can differ from true values, are introduced. Moreover, while the input model is specified under an ideal assumption that the controller can refer to the true value when it determines an action, the intermediate controller refers to the perceived value to reflect the reality of the perception. Although the intermediate controller determines its actions in response to perceived values, safety is not guaranteed because its behavior is the same as that of the input controller. For example, an autonomous vehicle may misperceive the distance to another car as 5 m when it is only 4 m, resulting in a collision. In the second step (robustification), the case distinction of the state of the environment is calculated. For instance, in some situations, an autonomous vehicle may be unsure of whether it should cruise or brake due to perceptual uncertainty about the distance between itself and a car ahead. The robustification method exhaustively lists such uncertain cases so that they are considered separately. In addition, the behavior of the controller is updated so that safety will be guaranteed even under perceptual uncertainty. The method considers all possibilities of the true value estimated from the perceived value and calculates behavior that is safe for every possibility. Constraints on the behavior of the generated controller are specified so that it is guaranteed to operate safely even under uncertainty. However, whether such constraints are satisfiable depends on the uncertainty. As an extreme example, if a sensor misperceives the positions of other cars up to 100 km, then guaranteeing safety is impossible in many situations. This raises the question of how much uncertainty the generated controller can tolerate. Where is the limit? To answer this, the proposed approach also generates the limit as a formula of uncertainty. Developers can choose appropriate sensors from a given catalog by using the formula as the criterion. In addition, the formula can be used to analyze uncertainty, such as how the uncertainty will be propagated if the controller is combined with other components. The method makes the construction of uncertainty-aware and safe controllers more systematic and effortless. Moreover, it enables developers to flexibly analyze various situations of perceptual uncertainty. Thus, the method improves the overall safety of the real world in which controller systems are implemented ubiquitously.

Future outlook

In addition to autonomous vehicles, the proposed method can also be applied to various other controller systems that interact with external environments. In future work, we intend to generalize the method so that it will be able to deal with a broader range of uncertainty. For instance, we will tackle misclassification problems such as an object classifier module classifying an object as a wrong object class.

Comments from Tsutomu Kobayashi

"Controller systems are crucial because most software systems' usefulness is due to their interactions with external environments. This research aims to help developers apply formal modeling approaches to realistic software by addressing the inevitable problem of controller systems regarding the gap between the perception and reality. Thus, developers can focus on the essence of controller behavior. We believe that the method is valuable and can be extended in various ways. We will continue working towards the systematic and easy application of rigorous mathematical methods to ensure a safe environment for everyone."

Information on Paper

Title

: Robustifying Controller Specifications of Cyber-Physical Systems Against Perceptual Uncertainty Authors

: Tsutomu Kobayashi, Rick Salay, Ichiro Hasuo, Krzysztof Czarnecki, Fuyuki Ishikawa, Shin-ya Katsumata Conference

: The 13th NASA Formal Methods Symposium https://shemesh.larc.nasa.gov/nfm2021/ Date of Presentation

: May 26th, 2021 (US Eastern Time)

(*1) ERATO Hasuo Metamathematics for Systems Design Project (ERATO-MMSD): a project funded in the Exploratory Research for Advanced Technology (ERATO) scheme of the Japan Science and Technology Agency (JST). The project conducts academic research for quality assurance of cyber-physical systems as the core of Society 5.0. The project specifically focuses on automated driving systems and investigates reliability techniques for modeling, formal verification, testing, and holistic, practical V&V techniques including all of them. This challenge requires tight collaboration of different academic areas such as software science and engineering, control theory and engineering, and artificial intelligence. Therefore, the project also focuses on (meta)mathematical theories. https://www.jst.go.jp/erato/hasuo/en/

INFORMATION:

About the National Institute of Informatics (NII)

NII is Japan's only academic research institute dedicated to the new discipline of informatics. Its mission is to "create future value" in informatics. NII conducts both long-term basic research and practical research aimed at solving social problems in a wide range of informatics research fields, from fundamental theories to the latest topics, such as artificial intelligence, big data, the Internet of Things, and information security.

As an inter-university research institute, NII builds and operates academic information infrastructure essential for the research and educational activities of the entire academic community (including the Science Information Network) as well as developing services such as those that enable the provision of academic content and service platforms. https://www.nii.ac.jp/en/

About the Research Organization of Information and Systems (ROIS)

ROIS is a parent organization of four national institutes (National Institute of Polar Research, National Institute of Informatics, the Institute of Statistical Mathematics and National Institute of Genetics) and the Joint Support-Center for Data Science Research. It is ROIS's mission to promote integrated, cutting-edge research that goes beyond the barriers of these institutions, in addition to facilitating their research activities, as members of inter-university research institutes.


[Attachments] See images for this press release:
Transformation of controller software to ensure safe behavior under perceptual uncertainty

ELSE PRESS RELEASES FROM THIS DATE:

Why wild African fruits can supplement low protein staple foods

2021-07-07
In the line-up of wild African fruits, the marula is the best known. For thousands of years, people have depended on the trees for food, medicines, and more. It is also exported globally as the rockstar ingredient of a cream liqueur. The fruit is a success story far beyond the savannas and bushveld where the trees grow. But there is a whole choir of other wild, indigenous fruits in Southern Africa. And some exceed daily nutritional values recommended by the WHO and others. Research from the University of Johannesburg uncovers a variety of building blocks for protein in the fruit of 14 species. Several are analyzed for ...

New model accurately predicts how coasts will be impacted by storms and sea-level rise

New model accurately predicts how coasts will be impacted by storms and sea-level rise
2021-07-07
Coastal communities across the world are increasingly facing up to the huge threats posed by a combination of extreme storms and predicted rises in sea levels as a result of global climate change. However, scientists at the University of Plymouth have developed a simple algorithm-based model which accurately predicts how coastlines could be affected and - as a result - enables communities to identify the actions they might need to take in order to adapt. The Forecasting Coastal Evolution (ForCE) model has the potential to be a game-changing advance in coastal evolution science, allowing adaptations in the shoreline to be predicted over timescales of anything from days to decades and beyond. This broad range of timescales means that the model is capable of predicting ...

Brain functional connectivity in Tourette syndrome

2021-07-07
Philadelphia, July 7, 2021 - Tourette syndrome, a neurodevelopmental disorder, causes motor and phonic "tics" or uncontrollable repeated behaviors and vocalizations. People affected by Tourette syndrome can often suppress these tics for some time before the urges become overwhelming, and researchers have long wondered at the neural underpinnings of the suppression effort. Now, in a new study using a non-invasive technique to measure brain activity called high-density electroencephalography (hdEEG), researchers at Yale School of Medicine have assessed the impact of tic suppression on functional ...

Understanding frailty will lead to better care for older adults

2021-07-07
Frailty is a better predictor than factors such as age when determining how older adults fare one year after receiving critical care. A team led by researchers from the University of Waterloo analyzed data from more than 24,000 community-dwelling older adults receiving home care in Ontario who were subsequently admitted into an intensive-care unit (ICU). They applied three different measures for baseline frailty and found that an individual's level of frailty was linked to survival one year later. The most frail ICU survivors had only a one in five chance of living to one year after discharge. Clinical frailty is age-related and characterized ...

UK public view COVID-19 as a threat because of lockdowns, new study suggests

2021-07-07
The UK public is likely to take the COVID-19 pandemic less seriously once restrictions are lifted, according to new research led by Cardiff University. Psychologists found lockdown in itself was a primary reason why so many people were willing to abide by the rules from the start - believing the threat must be severe if the government imposes such drastic measures. The team from Cardiff and the universities of Bath and Essex examined the reasons behind headline polling support for COVID-19 measures. They carried out two UK surveys*, six months apart, during 2020. Their findings are published today in the journal Royal Society Open Science. Lead author Dr Colin Foad said: "Surprisingly, we found that people judge the severity ...

Methane in the plumes of Saturn's moon Enceladus: Possible signs of life?

Methane in the plumes of Saturns moon Enceladus: Possible signs of life?
2021-07-07
An unknown methane-producing process is likely at work in the hidden ocean beneath the icy shell of Saturn's moon Enceladus, suggests a new study published in Nature Astronomy by scientists at the University of Arizona and Paris Sciences & Lettres University. Giant water plumes erupting from Enceladus have long fascinated scientists and the public alike, inspiring research and speculation about the vast ocean that is believed to be sandwiched between the moon's rocky core and its icy shell. Flying through the plumes and sampling their chemical makeup, the Cassini spacecraft detected a relatively high concentration of certain molecules associated with hydrothermal vents on the bottom of Earth's oceans, specifically dihydrogen, ...

UT Southwestern scientists closing in on map of the mammalian immune system

UT Southwestern scientists closing in on map of the mammalian immune system
2021-07-07
Using artificial intelligence, UT Southwestern scientists have identified thousands of genetic mutations likely to affect the immune system in mice. The work is part of one Nobel laureate's quest to find virtually all such variations in mammals. "This study identifies 101 novel gene candidates with greater than 95% chance of being required for immunity," says END ...

Scientists warn on the harmful implications of losing Indigenous and local knowledge systems

Scientists warn on the harmful implications of losing Indigenous and local knowledge systems
2021-07-06
Five Simon Fraser University scholars are among international scientists sounding an alarm over the "pervasive social and ecological consequences" of the destruction and suppression of the knowledge systems of Indigenous Peoples and local communities. Their paper, published today in the Journal of Ethnobiology, draws on the knowledge of 30 international Indigenous and non-Indigenous co-authors, and highlights 15 strategic actions to support the efforts of Indigenous Peoples and local communities in sustaining their knowledge systems and ties to lands. Study co-lead, SFU archaeology professor Dana Lepofsky, says, "We ...

Secret to weathering climate change lies at our feet

Secret to weathering climate change lies at our feet
2021-07-06
AMHERST, Mass. - Researchers at the University of Massachusetts Amherst recently discovered that the ability of agricultural grasses to withstand drought is directly related to the health of the microbial community living on their stems, leaves and seeds. "Microbes do an enormous amount for the grasses that drive the world's agriculture," says Emily Bechtold, a graduate student in UMass Amherst's microbiology department and lead author of the paper recently published in Applied and Environmental Microbiology. "They protect from pathogens, provide the grass with nutrients such as nitrogen, supply hormones to bolster the plant's health and growth, protect from UV radiation ...

Personalized medicine for cats with heart disease

Personalized medicine for cats with heart disease
2021-07-06
Veterinarians at the University of California, Davis, have found that a cat's DNA alters how it responds to a life-saving medication used to treat hypertrophic cardiomyopathy, or HCM, a heart disease that affects 1 in 7 cats. The END ...

LAST 30 PRESS RELEASES:

Reality check: making indoor smartphone-based augmented reality work

Overthinking what you said? It’s your ‘lizard brain’ talking to newer, advanced parts of your brain

Black men — including transit workers — are targets for aggression on public transportation, study shows

Troubling spike in severe pregnancy-related complications for all ages in Illinois

Alcohol use identified by UTHealth Houston researchers as most common predictor of escalated cannabis vaping among youths in Texas

Need a landing pad for helicopter parenting? Frame tasks as learning

New MUSC Hollings Cancer Center research shows how Golgi stress affects T-cells' tumor-fighting ability

#16to365: New resources for year-round activism to end gender-based violence and strengthen bodily autonomy for all

Earliest fish-trapping facility in Central America discovered in Maya lowlands

São Paulo to host School on Disordered Systems

New insights into sleep uncover key mechanisms related to cognitive function

USC announces strategic collaboration with Autobahn Labs to accelerate drug discovery

Detroit health professionals urge the community to act and address the dangers of antimicrobial resistance

3D-printing advance mitigates three defects simultaneously for failure-free metal parts 

Ancient hot water on Mars points to habitable past: Curtin study

In Patagonia, more snow could protect glaciers from melt — but only if we curb greenhouse gas emissions soon

Simplicity is key to understanding and achieving goals

Caste differentiation in ants

Nutrition that aligns with guidelines during pregnancy may be associated with better infant growth outcomes, NIH study finds

New technology points to unexpected uses for snoRNA

Racial and ethnic variation in survival in early-onset colorectal cancer

Disparities by race and urbanicity in online health care facility reviews

Exploring factors affecting workers' acquisition of exercise habits using machine learning approaches

Nano-patterned copper oxide sensor for ultra-low hydrogen detection

Maintaining bridge safer; Digital sensing-based monitoring system

A novel approach for the composition design of high-entropy fluorite oxides with low thermal conductivity

A groundbreaking new approach to treating chronic abdominal pain

ECOG-ACRIN appoints seven researchers to scientific committee leadership positions

New model of neuronal circuit provides insight on eye movement

Cooking up a breakthrough: Penn engineers refine lipid nanoparticles for better mRNA therapies

[Press-News.org] Transformation of controller software to ensure safe behavior under perceptual uncertainty
Bridging the gap between uncertain perception and reality in controller software design