(Press-News.org) Communication protocols for digital devices are very efficient but also very brittle: They require information to be specified in a precise order with a precise number of bits. If sender and receiver -- say, a computer and a printer -- are off by even a single bit relative to each other, communication between them breaks down entirely.
Humans are much more flexible. Two strangers may come to a conversation with wildly differing vocabularies and frames of reference, but they will quickly assess the extent of their mutual understanding and tailor their speech accordingly.
Madhu Sudan, an adjunct professor of electrical engineering and computer science at MIT and a principal researcher at Microsoft Research New England, wants to bring that type of flexibility to computer communication. In a series of recent papers, he and his colleagues have begun to describe theoretical limits on the degree of imprecision that communicating computers can tolerate, with very real implications for the design of communication protocols.
"Our goal is not to understand how human communication works," Sudan says. "Most of the work is really in trying to abstract, 'What is the kind of problem that human communication tends to solve nicely, [and] designed communication doesn't?' -- and let's now see if we can come up with designed communication schemes that do the same thing."
One thing that humans do well is gauging the minimum amount of information they need to convey in order to get a point across. Depending on the circumstances, for instance, one co-worker might ask another, "Who was that guy?"; "Who was that guy in your office?"; "Who was that guy in your office this morning?"; or "Who was that guy in your office this morning with the red tie and glasses?"
Similarly, the first topic Sudan and his colleagues began investigating is compression, or the minimum number of bits that one device would need to send another in order to convey all the information in a data file.
Uneven odds
In a paper presented in 2011, at the ACM Symposium on Innovations in Computer Science (now known as Innovations in Theoretical Computer Science, or ITCS), Sudan and colleagues at Harvard University, Microsoft, and the University of Pennsylvania considered a hypothetical case in which the devices shared an almost infinite codebook that assigned a random string of symbols -- a kind of serial number -- to every possible message that either might send.
Of course, such a codebook is entirely implausible, but it allowed the researchers to get a statistical handle on the problem of compression. Indeed, it's an extension of one of the concepts that longtime MIT professor Claude Shannon used to determine the maximum capacity of a communication channel in the seminal 1948 paper that created the field of information theory.
In Sudan and his colleagues' codebook, a vast number of messages might have associated strings that begin with the same symbol. But fewer messages will have strings that share their first two symbols, fewer still strings that share their first three symbols, and so on. In any given instance of communication, the question is how many symbols of the string one device needs to send the other in order to pick out a single associated message.
The answer to that question depends on the probability that any given interpretation of a string of symbols makes sense in context. By way of analogy, if your co-worker has had only one visitor all day, asking her, "Who was that guy in your office?" probably suffices. If she's had a string of visitors, you may need to specify time of day and tie color.
Existing compression schemes do, in fact, exploit statistical regularities in data. But Sudan and his colleagues considered the case in which sender and receiver assign different probabilities to different interpretations. They were able to show that, so long as protocol designers can make reasonable assumptions about the ranges within which the probabilities might fall, good compression is still possible.
For instance, Sudan says, consider a telescope in deep-space orbit. The telescope's designers might assume that 90 percent of what it sees will be blackness, and they can use that assumption to compress the image data it sends back to Earth. With existing protocols, anyone attempting to interpret the telescope's transmissions would need to know the precise figure -- 90 percent -- that the compression scheme uses. But Sudan and his colleagues showed that the protocol could be designed to accommodate a range of assumptions -- from, say, 85 percent to 95 percent -- that might be just as reasonable as 90 percent.
Buggy codebook
In a paper being presented at the next ITCS, in January, Sudan and colleagues at Columbia University, Carnegie Mellon University, and Microsoft add even more uncertainty to their compression model. In the new paper, not only do sender and receiver have somewhat different probability estimates, but they also have slightly different codebooks. Again, the researchers were able to devise a protocol that would still provide good compression.
They also generalized their model to new contexts. For instance, Sudan says, in the era of cloud computing, data is constantly being duplicated on servers scattered across the Internet, and data-management systems need to ensure that the copies are kept up to date. One way to do that efficiently is by performing "checksums," or adding up a bunch of bits at corresponding locations in the original and the copy and making sure the results match.
That method, however, works only if the servers know in advance which bits to add up -- and if they store the files in such a way that data locations correspond perfectly. Sudan and his colleagues' protocol could provide a way for servers using different file-management schemes to generate consistency checks on the fly.
"I shouldn't tell you if the number of 1's that I see in this subset is odd or even," Sudan says. "I should send you some coarse information saying 90 percent of the bits in this set are 1's. And you say, 'Well, I see 89 percent,' but that's close to 90 percent -- that's actually a good protocol. We prove this."
INFORMATION:
Written by Larry Hardesty, MIT News Office
Crocodilians, including the Australian saltwater crocodile, mutate at about a quarter of the rate of birds, new research has revealed.
The discovery is the result of genome sequencing three crocodilian species - the Australian saltwater crocodile, the American alligator and the Indian gharial - by an international collaboration of scientists, including six from the University of Sydney's Faculty of Veterinary Science.
The research is reported in a special edition of Science published on 12 December dedicated to all aspects of bird evolution and its closest living biological ...
New research published today in the journal Physical Review Letters describes how recreating isotopes that occur when a star explodes, can help physicists understand where life-supporting elements may be found in space.
For the first time, a research team led by the University of Surrey, Japan's RIKEN Nishina Centre and the University of Beihang, was able to observe the isotopes of certain elemental chemicals formed as a star explodes. The isotopes of these elements (samarium and gadolinium) are sensitive tracers of the way that stars explode, and therefore help in ...
The first ever landing of a man-made probe onto a comet has been named Physics World Breakthrough of the Year for 2014.
From a shortlist of 10 highly commended breakthroughs, the historic achievement by scientists working on the Rosetta mission was singled out by the Physics World editorial team for its significance and fundamental importance to space science.
The landing of the Philae probe, which captivated not only the physics community but millions of people worldwide, was the culmination of 10 years' work by scientists at the European Space Agency (ESA), who successfully ...
WINSTON-SALEM, N.C. - Dec. 12, 2014 - Understanding how nitrite can improve conditions such as hypertension, heart attack and stroke has been the object of worldwide research studies. New research from Wake Forest University has potentially moved the science one step closer to this goal.
In a paper published online ahead of print in the February issue of the Journal of Biological Chemistry, senior co-author Daniel Kim-Shapiro, professor of physics at Wake Forest, and others show that deoxygenated hemoglobin is indeed responsible for triggering the conversion of nitrite ...
A study looking at Jamie's Ministry of Food Australia 10-week program has found that it brings not only a change in attitudes but also in behavior when buying healthy food. The research published in the open access journal BMC Public Health has found that these changes continue up to six months after completion of the program.
Jamie's Ministry of Food was a campaign started with the aim of encouraging people to develop cooking skills to prepare simple, fresh and healthy food easily and quickly. It is based on a British initiative during the Second World War, which was ...
Malnutrition is a major cause of stunted growth in children, but new UCL research on mothers and children in Egypt suggests that the problem is not just about quantity of food but also quality.
Obesity and malnutrition are often thought of as problems at opposite ends of the nutrition spectrum, but the study found that 6.7% of Egyptian mothers were obese and had stunted children. In these 'double-burden' households with obese mothers and stunted children, malnutrition is unlikely to be down to scarcity of food.
The study, published in the Maternal and Child Health Journal, ...
In the Christmas issue of The BMJ, surgeons at the University Hospital of Wales examine the intertwined history of music and healing, and suggest tunes for surgeons and theatre staff to play - and to avoid - during operations.
As early as 4000 BC, "hallelujah to the healer" was played as part payment for medicinal services, while the ancient Greeks identified Apollo as the father of both healing and music. More recently, studies have shown beneficial calming and even pain relieving effects of music for patients having surgery.
But does music strike a chord with the ...
Sex differences in risk seeking behaviour, emergency hospital admissions, and mortality are well documented. Males are more likely to be admitted to an emergency department after accidential injuries, more likely to be admitted with a sporting injury, and more likely to be involved in a fatal road traffic collision.
However, little is known about sex differences in idiotic risk taking behaviour. So researchers in north east England decided to test "male idiot theory" (MIT) that many of the differences in risk seeking behaviour may be explained by the observation that ...
In fact, political centrists would do well to stop 'sitting on the fence' and boost their physical activity levels to improve their health, say the researchers.
The term "armchair socialist" was coined in the 19th century by German economists who scoffed at academics advocating social policy, dubbing them "socialists of the chair" (Kathedersozialisten).
The term has since evolved to describe middle class people who talk a lot about politics but who aren't politically active in any way, and fail to "walk the talk."
The concept has been widely adopted, prompting several ...
Fed up with complaints about the lack of up to date magazines in the waiting room of his general practice, Professor Bruce Arroll and colleagues set out to answer the question. Their findings are published in the Christmas issue of The BMJ.
A total of 87 magazines were stacked into three mixed piles and placed in the waiting room of a general practice in Auckland, New Zealand. They included non-gossipy magazines (Time magazine, the Economist, Australian Women's Weekly, National Geographic, BBC History) and gossipy ones (defined as having five or more photographs of celebrities ...
