(Press-News.org) Berkeley -- Researchers at the University of California, Berkeley, have developed algorithms that enable robots to learn motor tasks through trial and error using a process that more closely approximates the way humans learn, marking a major milestone in the field of artificial intelligence.
They demonstrated their technique, a type of reinforcement learning, by having a robot complete various tasks -- putting a clothes hanger on a rack, assembling a toy plane, screwing a cap on a water bottle, and more -- without pre-programmed details about its surroundings.
"What we're reporting on here is a new approach to empowering a robot to learn," said Professor Pieter Abbeel in UC Berkeley's Department of Electrical Engineering and Computer Sciences. "The key is that when a robot is faced with something new, we won't have to reprogram it. The exact same software, which encodes how the robot can learn, was used to allow the robot to learn all the different tasks we gave it."
The latest developments will be presented on Thursday, May 28, in Seattle at the International Conference on Robotics and Automation (ICRA). Abbeel is leading the project with fellow UC Berkeley faculty member Trevor Darrell, the director of the Berkeley Vision and Learning Center. Other members of the team are postdoctoral researcher Sergey Levine and Ph.D. student Chelsea Finn.
The work is part of a new People and Robots Initiative at UC's Center for Information Technology Research in the Interest of Society (CITRIS). The new multi-campus, multidisciplinary research initiative seeks to keep the dizzying advances in artificial intelligence, robotics and automation aligned to human needs.
"Most robotic applications are in controlled environments where objects are in predictable positions," said Darrell. "The challenge of putting robots into real-life settings, like homes or offices, is that those environments are constantly changing. The robot must be able to perceive and adapt to its surroundings."
Neural inspiration
Conventional, but impractical, approaches to helping a robot make its way through a 3D world include pre-programming it to handle the vast range of possible scenarios or creating simulated environments within which the robot operates.
Instead, the UC Berkeley researchers turned to a new branch of artificial intelligence known as deep learning, which is loosely inspired by the neural circuitry of the human brain when it perceives and interacts with the world.
"For all our versatility, humans are not born with a repertoire of behaviors that can be deployed like a Swiss army knife, and we do not need to be programmed," said Levine. "Instead, we learn new skills over the course of our life from experience and from other humans. This learning process is so deeply rooted in our nervous system, that we cannot even communicate to another person precisely how the resulting skill should be executed. We can at best hope to offer pointers and guidance as they learn it on their own."
In the world of artificial intelligence, deep learning programs create "neural nets" in which layers of artificial neurons process overlapping raw sensory data, whether it be sound waves or image pixels. This helps the robot recognize patterns and categories among the data it is receiving. People who use Siri on their iPhones, Google's speech-to-text program or Google Street View might already have benefited from the significant advances deep learning has provided in speech and vision recognition.
Applying deep reinforcement learning to motor tasks has been far more challenging, however, since the task goes beyond the passive recognition of images and sounds.
"Moving about in an unstructured 3D environment is a whole different ballgame," said Finn. "There are no labeled directions, no examples of how to solve the problem in advance. There are no examples of the correct solution like one would have in speech and vision recognition programs."
Practice makes perfect
In the experiments, the UC Berkeley researchers worked with a Willow Garage Personal Robot 2 (PR2), which they nicknamed BRETT, or Berkeley Robot for the Elimination of Tedious Tasks.
They presented BRETT with a series of motor tasks, such as placing blocks into matching openings or stacking Lego blocks. The algorithm controlling BRETT's learning included a reward function that provided a score based upon how well the robot was doing with the task.
BRETT takes in the scene, including the position of its own arms and hands, as viewed by the camera. The algorithm provides real-time feedback via the score based upon the robot's movements. Movements that bring the robot closer to completing the task will score higher than those that do not. The score feeds back through the neural net, so the robot can learn which movements are better for the task at hand.
This end-to-end training process underlies the robot's ability to learn on its own. As the PR2 moves its joints and manipulates objects, the algorithm calculates good values for the 92,000 parameters of the neural net it needs to learn.
With this approach, when given the relevant coordinates for the beginning and end of the task, the PR2 could master a typical assignment in about 10 minutes. When the robot is not given the location for the objects in the scene and needs to learn vision and control together, the learning process takes about three hours.
Abbeel says the field will likely see significant improvements as the ability to process vast amounts of data improves.
"With more data, you can start learning more complex things," he said. "We still have a long way to go before our robots can learn to clean a house or sort laundry, but our initial results indicate that these kinds of deep learning techniques can have a transformative effect in terms of enabling robots to learn complex tasks entirely from scratch. In the next five to 10 years, we may see significant advances in robot learning capabilities through this line of work."
INFORMATION:
The Defense Advanced Research Projects Agency, Office of Naval Research, U.S. Army Research Laboratory and National Science Foundation helped support this research.
WASHINGTON, D.C., May 22, 2015 -- Play a flute in Carnegie Hall, and the tone will resonate and fill the space. Play that same flute in the Grand Canyon, and the sound waves will crash against the rock walls, folding back in on each other in sonic chaos. The disparity in acoustics is clear - to the modern listener, the instrument belongs in an auditorium.
"Distinct echoes would be totally unforgivable in today's performance spaces," says Steven J. Waller, an archaeo-acoustician who has studied prehistoric rock art and the acoustics of ancient performance spaces. "But, ...
WASHINGTON, D.C., May 22, 2015 -- The room is loud with chatter. Glasses clink. Soft music, perhaps light jazz or strings, fills the air. Amidst all of these background sounds, it can be difficult to understand what an adjacent person is saying. A depressed individual, brought to this cocktail party by a well-meaning friend, can slide further into himself, his inability to hear and communicate compounding his sense of isolation.
"A lot of research has suggested that these people with elevated depression symptoms have a bias towards negative perception of information ...
Why do good people do bad things? It's a question that has been pondered for centuries, and new research published by the Society for Personality and Social Psychology may offer some insights about when people succumb to versus resist ethical temptations.
"People often think that bad people do bad things and good people do good things, and that unethical behavior just comes down to character," says lead research author Oliver Sheldon, PhD. "But most people behave dishonestly sometimes, and frequently, this may have more to do with the situation and how people ...
Parasitic worms can pose a serious threat to the Dungeness crab, a commercially important fishery species found along the west coast of North America. The worms are thought to have caused or contributed to the crash of the crab fishery of central California during the last half century. New research shows that infected crabs can rid themselves of parasites by moving into the less salty water of estuaries. Low salinity kills the worms creating a parasite refuge for the crabs.
The large Dungeness crab (Metacarcinus magister) is an important source of income for fishermen ...
Ecologists from the University of York, together with the Wildlife Conservation Society (WCS) and the Uganda Wildlife Authority (UWA), have developed a new method to better identify where poachers operate in protected areas.
Published in Conservation Biology, the analysis provides spatial maps of illegal activities within Queen Elizabeth National Park, one of Uganda's most important protected areas for elephant conservation.
Analysing 12 years of ranger-collected data, different types of threats were monitored and recorded, including the commercial hunting of large ...
The German Institute for Quality and Efficiency in Health Care (IQWiG) has assessed documents subsequently submitted by the drug manufacturer in the commenting procedure on the dossier assessment of the fixed-dose drug combination of ledipasvir and sofosbuvir (trade name: Harvoni). According to the findings, a hint of a non-quantifiable added benefit for a further patient group can be derived from this additional information.
This patient group consists of treatment-naive or pretreated patients with hepatitis C virus (HCV) infection of genotype 1 who are also infected ...
A larger brain brings better cognitive performance. And so it seems only logical that a larger brain would offer a higher survival potential. In the course of evolution, large brains should therefore win out over smaller ones. Previous tests of this hypothesis had relied on comparison studies looking at the intelligence and survival potential of species with large brains versus species with smaller brains. And species with larger brains do appear to have an advantage. But such studies are unable to show a causal relationship.
Alexander Kotrschal, Sarah Zala, Séverine ...
Increasing public knowledge and understanding about energy issues is vital if improved energy-saving behaviours are to be encouraged among individuals and organisations, a study suggests.
A survey conducted at Plymouth University indicated widespread misconceptions about energy which researchers said may be reducing the effectiveness of energy-saving behaviours.
It also showed varying levels of motivation and engagement with energy issues, with respondents saying they were uncertain about their capacity to influence business and government on matters of environmental ...
An association between resting heart rate and diabetes suggests that heart rate measures could identify individuals with a higher future risk of diabetes, according to an international team of researchers.
In a four-year study of 73,357 Chinese adults, researchers observed that faster heart rates were positively associated with an increased risk of developing diabetes. Researchers also found that faster heart rates were associated with impaired fasting glucose levels and a conversion from impaired fasting glucose levels to diabetes among the same population.
"In this ...
In a special issue, The Anatomical Record ventures into the world of human mummified remains. In 26 articles, the anatomy of mummies is exquisitely detailed through cutting edge examination, while they are put in historical, archeological, and cultural context. Investigators even take on the thorny issue of ethics as it applies to human remains in general and to the specific case of mummy research.
The eyes and tools of the 21st century meet the world of the past and allow one to think of mummies as more than just museum displays shrouded in mystery and fascination. ...
