A study identifies a universal property for efficient communication
The work has studied systems to name colours developed for artificial neural networks. A study by Marco Baroni, ICREA research professor at the Department of Translation and Language Sciences, together with members of Facebook AI Research (France)
2021-04-15
(Press-News.org) Words categorize the semantic fields they refer to in ways that maximize communication accuracy while minimizing complexity. Recent studies have shown that human languages are optimally balanced between accuracy and complexity. For example, many languages have a word that denotes the colour red, but no language has individual words to distinguish ten different shades of the colour. These additional words would complicate the vocabulary and rarely would they be useful to achieve precise communication.
A study published on 23 March in the journal Proceedings of the National Academy of Sciences of the United States of America analysed how artificial neural networks develop spontaneous systems to name colours. A study by Marco Baroni, ICREA research professor at the UPF Department of Translation and Language Sciences (DTCL), conducted with members of Facebook AI Research (France).
Optimal trade-offs between complexity and accuracy may be a universal property that arises in discrete communication systems, not related to specific features of human biology
For this study, the researchers formed two artificial neural networks trained with two generic deep learning methods. As Baroni explains: "we made the networks play a colour-naming game in which they had to communicate about colour chips from a continuous colour space. We did not limit the "language" they could use, however, when they learned to play the game successfully, we observed the colour-naming terms these artificial neural networks had developed spontaneously".
The results show that modern AI systems naturally adopt similar behaviours to humans
The authors found that the emerging colour vocabulary has exactly the same property of optimizing the complexity/accuracy trade-off found in human languages. Furthermore, this result is only maintained while the systems communicate via a discrete channel: when they are allowed to use continuous signals (such as whistles or non-linguistic hand gestures), their language loses efficiency.
From the point of view of cognitive science, the results suggest that optimal trade-offs between complexity and accuracy may be a universal property that arises in discrete communication systems, not related to specific features of human biology. Baroni adds: "the results show that modern AI systems naturally adopt similar behaviours to humans, which is nonetheless surprising".
This suggests that an efficient categorization of colours (and possibly other semantic domains) in natural languages is not dependent on specific human biological constraints, but is a general property of discrete communication systems.
INFORMATION:
Related work:
Rahma Chaabouni, Eugene Kharitonov, Emmanuel Dupoux, Marco Baroni (2021), "Communicating artificial neural networks develop efficient color-naming systems", 23 mars PNAS. https://doi.org/10.1073/pnas.2016569118
ELSE PRESS RELEASES FROM THIS DATE:
2021-04-15
The corona pandemic has had a major impact on the Nordic news media. At the same time as advertising revenues have fallen drastically, interest among the audience for professional news coverage has increased, according to a new report from Nordicom at the University of Gothenburg. Several Nordic media companies have also reported record sales of digital subscriptions as a result of the pandemic.
Covid-19 swept over the Nordic region and the rest of the world with full force in the spring of 2020. A year later, the pandemic still has the world in a strong grip. However, both the health-related ...
2021-04-15
ITHACA, N.Y. - Millions of people donate billions of dollars' worth of their time to citizen-science projects each year. While these efforts have broadened our understanding of everything from birds to bees to bracken ferns, rarely has citizen-science data informed policy at the highest levels of government. But that may be changing.
One of the world's largest citizen-science efforts, the Cornell Lab of Ornithology's eBird, is now helping the federal government streamline and refine its process for assessing eagle populations and informing eagle management.
New research out this week in the Journal of ...
2021-04-15
The results of the first clinical trial of a new vaccine for a neglected tropical disease have demonstrated that it is safe and induces immune responses in patients with the infection.
There are currently no vaccines to prevent leishmaniasis which is spread by the bite of sand flies and existing drugs have many side effects and are difficult to administer.
The potential new vaccine was developed by researchers at the Hull York Medical School, which is the joint medical school of the Universities of Hull and York.
Professor Paul Kaye from the Hull York Medical School was the principal investigator on the Wellcome Trust Translation Award that funded the development of the vaccine.
Professor Kaye said: ...
2021-04-15
Philadelphia, April 15, 2021--Researchers at Children's Hospital of Philadelphia (CHOP) have identified a key target that may be responsible for treatment failure in about 30% of patients with hemophilia A. The target, known as B cell activating factor (BAFF), appears to promote antibodies against and inhibitors of the missing blood clotting factor that is given to these patients to control their bleeding episodes. The findings, published in the Journal of Clinical Investigation, raise the possibility of using anti-BAFF therapies, potentially in combination with immune tolerance therapies, to tame the immune response in some patients with severe hemophilia A.
Hemophilia A is the most common inherited bleeding disorder, affecting ...
2021-04-15
Philadelphia, April 15, 2021 - Early and accurate diagnosis leads to optimal recovery from concussion. Over the past year across a series of studies, the Minds Matter Concussion Program research team at Children's Hospital of Philadelphia (CHOP) has systematically evaluated the use of the visio-vestibular examination (VVE) and its ability to enhance concussion diagnosis and management. The latest of these studies published online today in the Clinical Journal of Sports Medicine.
The VVE involves a series of brief eye movement and balance tests intended to identify deficits in brain function involving the visual and vestibular systems. Researchers found that the VVE presents several advantages over current clinical measures, moving beyond subjective symptoms ...
2021-04-15
April 15, 2021 - Decades after their days on the gridiron, middle-aged men who played football in high school are not experiencing greater problems with concentration, memory, or depression compared to men who did not play football, reports a study in Clinical Journal of Sport Medicine. The journal is published in the Lippincott portfolio by Wolters Kluwer.
"Men who played high-school football did not report worse brain health compared with those who played other contact sports, noncontact sports, or did not participate in sports during high school," according to the new research, led by Grant L. Iverson, PhD, of Harvard Medical School. The study offers reassurance that playing high-school football is not, in itself, a risk factor for cognitive or mood ...
2021-04-15
Triple-negative breast cancer (TNBC) is an aggressive type of breast cancer with a high fatality rate. Currently, chemotherapy is the major treatment option, but the clinical result is unsatisfactory. A research team led by biologists at City University of Hong Kong (CityU) has identified and characterised a set of specific super-enhancers that stimulate the activity of the related critical cancer genes. The research has also discovered that the deletion of certain specific super-enhancers can reduce tumour cell growth. The latest findings may help discover new effective drug targets for TNBC patients to improve their survival chance.
Traditionally, cancer research ...
2021-04-15
A key portion of MIT's campus overlaps with Kendall Square, the bustling area in East Cambridge where students, residents, and tech employees scurry around in between classes, meetings, and meals. Where are they all going? Is there a way to make sense of this daily flurry of foot traffic?
In fact, there is: MIT Associate Professor Andres Sevtsuk has made Kendall Square the basis of a newly published model of pedestrian movement that could help planners and developers better grasp the flow of foot traffic in all cities.
Sevtsuk's work emphasizes the functionality of a neighborhood's elements, above and beyond its physical form, making the model one that could be ...
2021-04-15
A new scientific discovery in Australia by Flinders University has recorded for the first time how ghost currents and sediments can 'undo' the force of gravity.
The new theory, just published in the Journal of Marine Systems, helps explain obscure events in which suspended sediment particles mysteriously move upward, not downward, on the slope of submarine canyons of the deep sea.
While this activity seems to contradict the laws of gravity, Flinders University physical oceanographer Associate Professor Jochen Kaempf has found an answer, devising the first scientific explanation of the observed upslope sediment transport.
"To put it simply, the vehicle of this transport are currents that, while carrying ...
2021-04-15
Many long for a return to a post-pandemic "normal," which, for some, may entail concerts, travel, and large gatherings. But how to keep safe amid these potential public health risks?
One possibility, according to a new study, is dogs. A proof-of-concept investigation published today in the journal PLOS ONE suggests that specially trained detection dogs can sniff out COVID-19-positive samples with 96% accuracy.
"This is not a simple thing we're asking the dogs to do," says Cynthia Otto, senior author on the work and director of the University of Pennsylvania School of Veterinary Medicine Working Dog Center. "Dogs have to ...
LAST 30 PRESS RELEASES:
[Press-News.org] A study identifies a universal property for efficient communication
The work has studied systems to name colours developed for artificial neural networks. A study by Marco Baroni, ICREA research professor at the Department of Translation and Language Sciences, together with members of Facebook AI Research (France)
