Mixed reality gets a machine learning upgrade
Researchers at Osaka University use machine learning to enhance the ability of a mixed-reality mobile viewer to digitally remove obstructions and add greenery, which may improve sustainable architecture and urban planning
2021-03-24
(Press-News.org) Osaka, Japan - Scientists from the Division of Sustainable Energy and Environmental Engineering at Osaka University employed deep learning artificial intelligence to improve mobile mixed reality generation. They found that occluding objects recognized by the algorithm could be dynamically removed using a video game engine. This work may lead to a revolution in green architecture and city revitalization.
Mixed reality (MR) is a type of visual augmentation in which real-time images of existing objects or landscapes can be digitally altered. As anyone who has played Pokémon Go! or similar games knows, looking at a smartphone screen can feel almost like magic when characters appear alongside real landmarks. This approach can be applied for more serious undertakings as well, such as visualizing what a new building will look like once the existing structure is removed and trees added. However, this kind of digital erasure was thought to be too computationally intensive to generate in real time on a mobile device.
Now, researchers at Osaka University have demonstrated a new system that can construct a MR landscape visualization faster with the help of deep learning. The key is to train the algorithm with thousands of labeled images so that it can more quickly identify occlusions, like walls and fences. This allows for the automatic "semantic segmentation" of the view into elements to be kept and others to be masked. The program also quantitatively measured the Green View Index (GVI), which is the fraction of greenery areas including plants and trees in a person's visual field, in either the current or proposed layout. "We were able to implement both dynamic occlusion and Green View Index estimation in our mixed reality viewer," corresponding author Tomohiro Fukuda says.
Live video is sent to a semantic segmentation server, and the result is used to render the final view with a game engine on the mobile device. Proposed structures and greenery can be shown even when the viewing angle is changed. "Internet speed and latency were evaluated to ensure real-time MR rendering," first author Daiki Kido explains. The team hopes this research will help stakeholders understand the importance of GVI on urban planning.
INFORMATION:
The article, "Assessing future landscapes using enhanced mixed reality with semantic segmentation by deep learning," was published in Advanced Engineering Informatics at DOI: https://doi.org/10.1016/j.aei.2021.101281
About Osaka University
Osaka University was founded in 1931 as one of the seven imperial universities of Japan and is now one of Japan's leading comprehensive universities with a broad disciplinary spectrum. This strength is coupled with a singular drive for innovation that extends throughout the scientific process, from fundamental research to the creation of applied technology with positive economic impacts. Its commitment to innovation has been recognized in Japan and around the world, being named Japan's most innovative university in 2015 (Reuters 2015 Top 100) and one of the most innovative institutions in the world in 2017 (Innovative Universities and the Nature Index Innovation 2017). Now, Osaka University is leveraging its role as a Designated National University Corporation selected by the Ministry of Education, Culture, Sports, Science and Technology to contribute to innovation for human welfare, sustainable development of society, and social transformation.
Website: https://resou.osaka-u.ac.jp/en
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
2021-03-24
Osaka, Japan - Most of the devices used in our daily lives are operated and controlled by electricity. From the standpoint of safety and the tight supply and demand of electricity, circuit design that satisfies low electromagnetic noise and power saving is becoming increasingly important.
In an electric circuit, electric signals transmit inside the conductor, and electromagnetic fields radiate outside the conductor. Furthermore, the electromagnetic field propagates through the air and is converted into signals for itself and other circuits, which leads to electromagnetic noise. Now, a research team at Osaka University has formulated a numerical method ...
2021-03-24
At the bottom of the world, there's a small island about four kilometers off the coast of Antarctica. In summer, temperatures climb to freezing with uninterrupted daylight for two months. In winter, they fall to minus 40 degrees Celsius without a single sunrise for two months. It is isolated and desolate, uninhabitable to all humans -- except for the Japanese Antarctic Research Expedition (JARE). Almost every year since 1956, a JARE team winters over on the island, staying in Syowa Station, from February to January to conduct various research projects. From 2004 to 2014, however, they were also research subjects themselves.
As part of a joint project between the National Institute of Polar Research at the Research Organization of Information and Systems ...
2021-03-24
Materials science likes to take nature and the special properties of living beings that could potentially be transferred to materials as a model. A research team led by chemist Professor Andreas Walther of Johannes Gutenberg University Mainz (JGU) has succeeded in endowing materials with a bioinspired property: Wafer-thin stiff nanopaper instantly becomes soft and elastic at the push of a button. "We have equipped the material with a mechanism so that the strength and stiffness can be modulated via an electrical switch," explained Walther. As soon as an electric current is applied, the nanopaper becomes soft; when the current flow stops, it regains its strength. From an application perspective, this switchability could be interesting for damping ...
2021-03-24
Tokyo, Japan - Scientists from the Graduate School of Information Science and Technology at The University of Tokyo calculated the efficiency of the sensory network that bacteria use to move towards food and found it to be optimal from an information theory standpoint. This work may lead to a better understanding of bacterial behavior and their sensory networks.
Despite being single-celled organisms, bacteria such as E. Coli can perform some impressive feats of sensing and adaptation in constantly changing environmental conditions. For example, these bacteria can sense the presence of a chemical ...
2021-03-24
Imbued with special electric, mechanical and other physical properties due to their tiny size, nanofibers are considered leading-edge technology in biomedical engineering, clean energy and water quality control, among others. Now, researchers in Italy and UK have developed an automatic process to assess nanofiber fabrication quality, producing 30% more accurate results than currently used techniques.
Details were published on January 2021 in IEEE/CAA Journal of Automatica Sinica, a joint publication of the IEEE and the Chinese Association of Automation.
"In recent years, nanostructured materials have gained continuously growing interest both in scientific and industrial contexts, because of their research appeal and versatile applications," ...
2021-03-24
SMN or in full Survival Motor Neuron: Professor Utz Fischer has been analyzing this protein and the large molecular complex of the same name, of which SMN is one of the building blocks, for many years. He holds the Chair of the Department of Biochemistry at the Julius-Maximilian's University of Würzburg (JMU), and he first discovered the molecule during his search for the root cause of spinal muscular atrophy. As scientists found out a few years ago, this disease is caused by a lack of the SNM complex.
The work group around Prof. Fischer has now succeeded in presenting a first three-dimensional model of the ...
2021-03-24
In a ground-breaking first, researchers have fabricated 3D scaffold implants containing antibiotics at high temperatures. These scaffolds not only support bone regeneration but manage the bone infections that can arise as a result of injury or surgery.
Each year, around 4 million people worldwide develop bone infection following an open fracture or surgery. The gold standard treatment consists of a lengthy antibiotic therapy, usually delivered orally or Intravenously, and the removal of infected bone tissue, which often leaves behind a hole too large for the body to fill via normal bone regeneration. In a study published in the KeAi journal Bioactive Materials, a group of researchers from the Netherlands, Italy and Spain, outline a new treatment ...
2021-03-24
A genetic variation that regulates iron metabolism may enhance athletes' endurance performance, researchers at the University of Toronto have shown.
The findings could help explain studies that show an association between the genetic variation and elite athletes across many sports, and may help competitive athletes fine-tune their iron intake to boost performance.
The variation, found in the homeostatic iron regulator (HFE) gene, is a known cause of iron overload, a condition called hemochromatosis in which the body absorbs too much iron leading to organ and joint damage.
Athletes at risk for hemochromatosis but with iron stores below potentially toxic levels could have ...
2021-03-24
Bacteria plucked from a desert plant could help crops survive heatwaves and protect the future of food.
Global warming has increased the number of severe heatwaves that wreak havoc on agriculture, reduce crop yields and threaten food supplies. However, not all plants perish in extreme heat. Some have natural heat tolerance, while others acquire heat tolerance after previous exposure to higher temperatures than normal, similar to how vaccines trigger the immune system with a tiny dose of virus.
But breeding heat tolerant crops is laborious and expensive, and slightly warming entire fields is even trickier.
There is growing interest in harnessing microbes to protect plants, and biologists have shown that root-dwelling bacteria can help their herbaceous ...
2021-03-24
Researchers from Tokyo Medical and Dental University (TMDU) identify biomaterials that can be used to modulate liver immune cell behavior
Tokyo, Japan - Biomaterials are substances, natural or manmade, that are used in medicine to interact with the human body for various purposes, such as wound healing and tissue regeneration. Previous work on biomaterials has shown that they can affect cells in many ways, including how they grow, move, and the type of cell they develop into. Scientists have recently begun investigating biomaterials with properties that can be fine-tuned to optimize their use in regenerative ...
LAST 30 PRESS RELEASES:
[Press-News.org] Mixed reality gets a machine learning upgrade
Researchers at Osaka University use machine learning to enhance the ability of a mixed-reality mobile viewer to digitally remove obstructions and add greenery, which may improve sustainable architecture and urban planning
