(Press-News.org) This news release is available in German.
It does seem slightly odd at first: you hold the phone in one hand, and move the other in the air above its built-in camera making gestures that resemble sign language. Sometimes you move your index finger to the left, sometimes to the right. You can spread out your fingers, or imitate a pair of pliers or the firing of a pistol. These gestures are not, however, intended for communicating with deaf people; they are for controlling your smartphone.
By mimicking the firing of a pistol, for example, a user can switch to another browser tab, change the map's view from satellite to standard, or shoot down enemy planes in a game. Spreading out your fingers magnifies a section of a map or scrolls the page of a book forwards.
All this gesturing wizardry is made possible by a new type of algorithm developed by Jie Song, a Master's student in the working group headed by by Otmar Hilliges, Professor of Computer Science. The researchers presented the app to an audience of industry professionals at the UIST symposium in Honolulu, Hawaii.
Intelligent programming uses computer memory efficiently
The program uses the smartphone's built-in camera to register its environment. It does not evaluate depth or colour. The information it does register – the shape of the gesture, the parts of the hand – is reduced to a simple outline that is classified according to stored gestures. The program then executes the command associated with the gesture it observes. The program also recognises the hand's distance from the camera and warns the user when the hand is either too close or too far away.
"Many movement-recognition programs need plenty of processor and memory power", explains Hilliges, adding that their new algorithm uses a far smaller portion of computer memory and is thus ideal for smartphones. He believes the application is the first of its kind that can run on a smartphone. The app's minimal processing footprint means it could also run on smart watches or in augmented-reality glasses.
More control
The program currently recognises six different gestures and executes their corresponding commands. Although the researchers have tested 16 outlines, this is not the app's theoretical limit. What matters is that gestures generate unambiguous outlines. Gestures that resemble others are not suitable for this application. "To expand its functionality, we're going to add further classification schemes to the program", says the ETH researcher.
He is convinced that this new way of operating smartphones greatly increases the range of interactivity. The researcher's objective is to keep the gestures as simple as possible, so that users can operate their smartphone effortlessly.
But will smartphone users want to adapt to this new style of interaction? Otmar Hilliges is confident they will. Gesture control will not replace touchscreen control, but supplement it. "People got used to operating computer games with their movements." Touchscreens, Hilliges reminds us, also required a very long adjustment period before making a big impact in consumers' lives. He is therefore certain that this application – or at least parts of it – will find its way onto the market.
INFORMATION:
Reference
Song J, Sörös G, Pece F, Fanello S, Izadi S, Keskin C, Hilliges O: In-air Gestures Around Unmodified Mobile Devices, ACM User Interface Software and Technology Symposium, Honolulu, Hawaii, 7 October 2014
The remnants of Hurricane Simon were fanning out over the desert Southwestern U.S. on Oct. 8 and NASA's Aqua satellite captured infrared data on the thunderstorms expected to bring flash flooding.
NOAA's National Weather Service (NWS) indicated on Oct. 8, that Simon's remnants would be bringing heavy rain and the possibility of flash flooding to the desert Southwest. NWS noted "Moisture associated with the remnants of Tropical Storm Simon will bring showers and isolated thunderstorms to parts of the Desert Southwest on Wednesday. Rainfall totals of up to an inch or more ...
A government program to provide health insurance for catastrophic illness to households below the poverty line in Karnataka, lowered both mortality rates and out-of-pocket expenses for the residents, according to a recent evaluation published in the leading global health journal The BMJ.
The program is implemented by the Karnataka government with support from the World Bank Group.
An evaluation of the program, the Vajpayee Arogyashree Scheme (VAS), funded by the World Bank Group and led by Neeraj Sood, professor and director of research at the USC Schaeffer Center for ...
The sports media's positive reaction to the hiring of a female referee in professional football is a good sign, according to a Penn State researcher, but did little to help expose deeper issues that hinder greater acceptance of women in sports.
In a study of online stories and posts about the hiring of Shannon Eastin as an NFL official during the 2012 referee's union strike, Dunja Antunovic, a doctoral candidate in mass communications, said that the media mostly celebrated her NFL debut.
"It was generally positive," said Antunovic. "However, it might be a mistake to ...
COLUMBUS, Ohio – The risk of developing cancer in a salivary gland might be higher in people with mutations in either of two genes associated with breast and ovarian cancer, according to a new study by researchers at The Ohio State University Comprehensive Cancer Center – Arthur G. James Cancer Hospital and Richard J. Solove Research Institute (OSUCCC – James).
Although salivary gland cancer is rare, this retrospective study suggests it occurs 17 times more often in people with inherited mutations in genes called BRCA1 and BRCA2, than those in the general ...
It is estimated that as many as half of patients taking cancer drugs experience a decrease in mental sharpness. While there have been many theories, what causes "chemo brain" has eluded scientists.
In an effort to solve this mystery, neuroscientists at The University of Texas Health Science Center at Houston (UTHealth) conducted an experiment in an animal memory model and their results point to a possible explanation. Findings appeared in The Journal of Neuroscience.
In the study involving a sea snail that shares many of the same memory mechanisms as humans and a drug ...
Certain types of corals, invertebrates of the sea that have been on Earth for millions of years, appear to have found a way to survive some of their most destructive threats by attaching to and growing under mangrove roots.
Scientists with the U.S. Geological Survey and Eckerd College recently published research on a newly discovered refuge for reef-building corals in mangrove habitats of the U.S. Virgin Islands. More than 30 species of reef corals were found growing in Hurricane Hole, a mangrove habitat within the Virgin Islands Coral Reef National Monument in St. John.
Corals ...
CHAMPAIGN, Ill. — A new study offers fresh insights into how talking on a cell phone or to a passenger while driving affects one's performance behind the wheel. The study used a driving simulator and videophone to assess how a driver's conversation partner influences safety on the road.
"We've done years of study on driver distraction, and previous studies suggest that passengers often aren't distracting. In fact, passengers can be helpful, especially if they're adults who have had experience and also are active drivers themselves," said University of Illinois psychology ...
Peer-to-peer file sharing of movies, television shows, music, books and other files over the Internet has grown rapidly worldwide as an alternative approach for people to get the digital content they want -- often illicitly. But, unlike the users of Amazon, Netflix and other commercial providers, little is known about users of peer-to-peer (P2P) systems because data is lacking.
Now, armed with an unprecedented amount of data on users of BitTorrent, a popular file-sharing system, a Northwestern University research team has discovered two interesting behavior patterns: ...
Cold Spring Harbor, NY – It's one of those ideas that seems to make perfect sense: the bigger the brain, the more intelligent the creature. While it is generally true, exceptions are becoming increasingly common. Yet the belief persists even among scientists. Most biologists, for example, assume that rats, with larger brains, are smarter than mice. Cold Spring Harbor Laboratory (CSHL) scientists now challenge this belief. They compared mice and rats and found very similar levels of intelligence, a result that could have powerful implications for researchers studying ...
WASHINGTON - Children who are emotionally abused and neglected face similar and sometimes worse mental health problems as children who are physically or sexually abused, yet psychological abuse is rarely addressed in prevention programs or in treating victims, according to a new study published by the American Psychological Association.
"Given the prevalence of childhood psychological abuse and the severity of harm to young victims, it should be at the forefront of mental health and social service training," said study lead author Joseph Spinazzola, PhD, of The Trauma ...
