(Press-News.org) Microphones are perhaps the most common electronic sensor in the world, with an estimated 320 million listening for our commands in the world's smart speakers. The trouble is that they're capable of hearing everything else, too.
But now, a team of University of Michigan researchers has developed a system that can inform a smart home--or listen for the signal that would turn on a smart speaker--without eavesdropping on audible sound.
The key to the device, called PrivacyMic, is ultrasonic sound at frequencies above the range of human hearing. Running dishwashers, computer monitors, even finger snaps, all generate ultrasonic sounds, which have a frequency of 20 kilohertz or higher. We can't hear them--but dogs, cats and PrivacyMic can.
The system pieces together the ultrasonic information that's all around us to identify when its services are needed, and sense what's going on around it. Researchers have demonstrated that it can identify household and office activities with greater than 95% accuracy.
"There are a lot of situations where we want our home automation system or our smart speaker to understand what's going on in our home, but we don't necessarily want it listening to our conversations," said Alanson Sample, U-M associate professor of electrical engineering and computer science. "And what we've found is that you can have a system that understands what's going on and a hard guarantee that it will never record any audible information."
Ubiquitous computing + privacy
PrivacyMic can filter out audible information right on the device. That makes it more secure than encryption or other security measures that take steps to secure audio data after it's recorded or limit who has access to it. Those measures could all leave sensitive information vulnerable to hackers, but with PrivacyMic, the information simply doesn't exist.
While smart speakers are an obvious application, the research team envisions many others that, while less common, may be more important. In-home ultrasonic devices, for example, could monitor the homes of the elderly for signs that they need help, monitor lung function in respiratory patients or listen to clinical trial participants for sonic signatures that could reveal medication side effects or other problems.
"A conventional microphone placed in somebody's home for months at a time could give doctors richer information than they've ever had before, but patients just aren't willing to do that with today's technology," Sample said. "But an ultrasonic device could give doctors and medical schools unprecedented insight into what their patients' lives are really like in a way that the patients are much more likely to accept."
The idea behind PrivacyMic began when the team was classifying previously recorded audio. Looking at a visual graph of the data, they realized that audible sound was only a small piece of what was available.
"We realized that we were sitting on a lot of interesting information that was being ignored. We could actually get a picture of what was going on in a home or office without using any audio at all," said Yasha Iravantchi, a graduate student in electrical engineering and computer science and first author on a new paper on the research.
Listening for ultrasonic sound
Armed with this insight, a laptop and an ultrasonic microphone, the team then went to work capturing audio from tooth brushing, toilet flushing, vacuuming, running dishwashers, using computer monitors and hundreds of other common activities. They then compressed the ultrasonic signatures into smaller files that included key bits of information while stripping out noise within the range of human hearing--a bit like an ultrasonic MP3--and built a Raspberry Pi-based device to listen for them.
The device, which can be set to filter out speech or to strip out all audible content, accurately identified common activities more than 95% of the time. The team also conducted a trial where study participants listened to the audio collected by the device and found that not a single participant could make out human speech.
While the device is a proof of concept at this stage, Sample says that implementing similar technology in a device like a smart speaker would require only minor modifications--software that listens for ultrasonic sound and a microphone capable of picking it up, which are inexpensive and readily available. While such a device is likely several years off, the team has applied for patent protection through the U-M Office of Technology Transfer.
"Smart technology today is an all-or-nothing proposition. You can either have nothing or you can have a device that's capable of constant audio recording," Sample said. "PrivacyMic offers another layer of privacy--you can interact with your device using audio if you choose or you can have another setting where the device can glean information without picking up audio."
INFORMATION:
The paper is titled "PrivacyMic: Utilizing Inaudible Frequencies for Privacy Preserving Daily Activity Recognition." The researchers presented it May 12 at the ACM CHI Virtual Conference on Human Factors in Computing Systems. Other researchers on the project included Karan Ahuja, Mayank Goel and Chris Harrison, all at Carnegie Mellon University.
Written by Gabe Cherry
CHAMPAIGN, Ill. -- Scientists working to understand the cellular processes linking high cholesterol to breast cancer recurrence and metastasis report that a byproduct of cholesterol metabolism causes some cells to send out cancer-promoting signals to other cells. These signals are packaged in membrane-bound compartments called extracellular vesicles.
Reported in the journal Endocrinology, the discovery could lead to the development of new anti-cancer therapies, researchers say.
"Extracellular vesicles play an important role in normal physiology, but they also have been ...
A population-based study, published today in JAMA, has found flu vaccination during pregnancy does not lead to an increased risk of adverse early childhood health outcomes.
Although pregnant people are not more susceptible to acquiring influenza infection, they are at an increased risk of severe illness and complications if they get the flu during pregnancy. For this reason, all pregnant people are advised to receive a flu shot each year, yet only 36 percent received it according to a study monitoring four flu seasons in Nova Scotia. Safety concerns are reportedly a leading reason people may not receive influenza ...
DARIEN, IL - Dreams result from a process that often combines fragments of multiple life experiences and anticipates future events, according to novel evidence from a new study.
Results show that 53.5% of dreams were traced to a memory, and nearly 50% of reports with a memory source were connected to multiple past experiences. The study also found that 25.7% of dreams were related to specific impending events, and 37.4% of dreams with a future event source were additionally related to one or more specific memories of past experiences. Future-oriented dreams became proportionally more common later in the night.
"Humans ...
ROCHESTER, Minn. -- Mayo Clinic researchers and colleagues at the University of Minnesota showed that COVID-19 exacerbates the damaging impact of senescent cells in the body. In preclinical studies, the senolytic drugs discovered at Mayo significantly reduced inflammation, illness, and mortality from COVID infection in older mice. The findings appear in the journal Science.
Senescent cells (damaged or non-functioning cells that persist in the body) contribute to many aspects of aging and illness, including inflammation and multiple chronic diseases. Based on the "Amplifier/Rheostat Hypothesis" of senescent ...
A study of the associations between drinking alcohol and the chances of becoming pregnant suggests that women who want to conceive should avoid heavy drinking. In the second half of menstrual cycle even moderate drinking is linked to reduced chances of pregnancy.
The study, published today (Wednesday) in Human Reproduction [1], one of the world's leading reproductive medicine journals, investigated alcohol intake and fecundability, which is defined as the probability of conceiving during a single menstrual cycle. It is the first study to look at this according to the difference phases of women's menstrual cycles.
Researchers led by Dr Kira Taylor, associate professor of epidemiology and population ...
As new research on anaesthesia trainee morale is published, an impassioned plea is today being made in an open letter from the Association of Anaesthetists to the UK's four Health Secretaries: to urgently double the number of training posts for anaesthetists this summer and for subsequent years so that the UK can safely negotiate the current COVID-19 pandemic, any future pandemics, and deal with the huge backlog of surgical procedures that has built up during lockdown.
The Association has sent a separate letter to go to each Health Secretary - Matt Hancock MP in the UK Department of Health, Humza Yousaf MSP in Scotland, Baroness Eluned Morgan MS in Wales, and Robin Swann MLA in ...
According to the National Alliance on Mental Illness and the World Health Organization, depression affects 16 million Americans and 322 million people worldwide. Emerging evidence suggests that the COVID-19 pandemic is further exacerbating the prevalence of depression in the general population. With this trajectory, it is evident that more effective strategies are needed for therapeutics that address this critical public health issue.
In a recent study, publishing in the June 9, 2021 online edition of Nature Translational Psychiatry, researchers at University of California San Diego School of Medicine used a combination of modalities, such as measuring brain function, cognition and lifestyle factors, to generate individualized predictions of depression.
The machine learning and personalized ...
In "Atchafalaya," John McPhee's essay in the 1989 book The Control of Nature, the author chronicles efforts by the U.S. Army Corps of Engineers to prevent the Atchafalaya River from changing the course of the Mississippi River where they diverge, due to the Atchafalaya's steeper gradient and more direct route to the gulf. McPhee's classic essay proved inspirational to John Shaw, an assistant professor of geosciences who called it "a foundational text."
Indeed, his latest work adds to the story.
In a recent paper published in the American Geophysical Union's journal, Water ...
Everyone is familiar with tiny gas bubbles gently rising up in sparkling water. But the bubbles that were created by intense focused lasers in this experiment were ten times smaller and contained water vapour at a pressure around a hundred thousand times higher. Under these conditions, the bubble expands at supersonic speed and pushes a shockwave, consisting of a spherical shell of highly compressed water, ahead of itself. Now the research team led by the University of Göttingen, together with the Deutsches Elektronen-Synchroton (DESY) and the European X-Ray Free-Electron Laser (European XFEL), has created such an event and then, with an innovative ...
The analysis of very old plant fossils discovered in South Africa and dating from the Lower Devonian period documents the transition from barren continents to the green planet we know today. Cyrille Prestianni, a palaeobotanist at the EDDy Lab at the University of Liège (Belgium), participated in this study, the results of which have just been published in the journal Scientific Reports.
The greening of continents - or terrestrialisation - is undoubtedly one of the most important processes that our planet has undergone. For most of the Earth's history, the continents were devoid of macroscopic ...
