(Press-News.org) Remember when IBM’s Deep Blue won against Gary Kasparov at chess in 1996, or Google’s AlphaGo crushed the top champion Lee Sedol at Go, a much more complex game, in 2016? These competitions where machines prevailed over human champions are key milestones in the history of artificial intelligence. Now a group of researchers from the University of Zurich and Intel has set a new milestone with the first autonomous system capable of beating human champions at a physical sport: drone racing.
The AI system, called Swift, won multiple races against three world-class champions in first-person view (FPV) drone racing, where pilots fly quadcopters at speeds exceeding 100 km/h, controlling them remotely while wearing a headset linked to an onboard camera.
Learning by interacting with the physical world
“Physical sports are more challenging for AI because they are less predictable than board or video games. We don’t have a perfect knowledge of the drone and environment models, so the AI needs to learn them by interacting with the physical world,” says Davide Scaramuzza, head of the Robotics and Perception Group at the University of Zurich – and newly minted drone racing team captain.
Until very recently, autonomous drones took twice as long as those piloted by humans to fly through a racetrack, unless they relied on an external position-tracking system to precisely control their trajectories. Swift, however, reacts in real time to the data collected by an onboard camera, like the one used by human racers. Its integrated inertial measurement unit measures acceleration and speed while an artificial neural network uses data from the camera to localize the drone in space and detect the gates along the racetrack. This information is fed to a control unit, also based on a deep neural network that chooses the best action to finish the circuit as fast as possible.
Training in an optimised simulation environment
Swift was trained in a simulated environment where it taught itself to fly by trial and error, using a type of machine learning called reinforcement learning. The use of simulation helped avoid destroying multiple drones in the early stages of learning when the system often crashes. “To make sure that the consequences of actions in the simulator were as close as possible to the ones in the real world, we designed a method to optimize the simulator with real data,” says Elia Kaufmann, first author of the paper. In this phase, the drone flew autonomously thanks to very precise positions provided by an external position-tracking system, while also recording data from its camera. This way it learned to autocorrect errors it made interpreting data from the onboard sensors.
Human pilots still adapt better to changing conditions
After a month of simulated flight time, which corresponds to less than an hour on a desktop PC, Swift was ready to challenge its human competitors: the 2019 Drone Racing League champion Alex Vanover, the 2019 MultiGP Drone Racing champion Thomas Bitmatta, and three-times Swiss champion Marvin Schaepper. The races took place between 5 and 13 June 2022, on a purpose-built track in a hangar of the Dübendorf Airport, near Zurich. The track covered an area of 25 by 25 meters, with seven square gates that had to be passed in the right order to complete a lap, including challenging maneuvers including a Split-S, an acrobatic feature that involves half-rolling the drone and executing a descending half-loop at full speed.
Overall, Swift achieved the fastest lap, with a half-second lead over the best lap by a human pilot. On the other hand, human pilots proved more adaptable than the autonomous drone, which failed when the conditions were different from what it was trained for, e.g., if there was too much light in the room.
Pushing the envelope in autonomous flight is important way beyond drone racing, Scaramuzza notes. “Drones have a limited battery capacity; they need most of their energy just to stay airborne. Thus, by flying faster we increase their utility.” In applications such as forest monitoring or space exploration, for example, flying fast is important to cover large spaces in a limited time. In the film industry, fast autonomous drones could be used for shooting action scenes. And the ability to fly at high speeds could make a huge difference for rescue drones sent inside a building on fire.
Video available https://youtu.be/fBiataDpGIo
Literature:
Elia Kaufmann, Leonard Bauersfeld, Antonio Loquercio, Matthias Müller, Vladlen Koltun, Davide Scaramuzza: Champion-Level Drone Racing using Deep Reinforcement Learning. Nature. 30 August 2023. DOI: 10.1038/s41586-023-06419-4
Contact:
Prof. Davide Scaramuzza
Robotics and Perception Group
Department of Informatics
University of Zurich
Phone: +41 44 635 24 09
Video available https://youtu.be/fBiataDpGIo
END
Challenge accepted: High-speed AI drone overtakes world-champion drone racers
2023-08-30
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
Could a cancer drug hold the key to a HIV cure?
2023-08-30
An existing blood cancer drug has shown promise in killing ‘silent’ HIV cells and delaying reinfections – a significant pre-clinical discovery that could lead to a future cure for the disease.
Hidden HIV cells, known as latent infection, are responsible for the virus permanently remaining in the body and cannot be treated by current therapy options. These hibernating, infected cells are the reason why people living with HIV require life-long treatment to suppress the virus.
Led by WEHI and The Peter Doherty Institute for Infection ...
Robustness of the world's skyscrapers stress-tested by Surrey model
2023-08-30
The safety of tall buildings in the world's cities, in the face of extreme external traumas like vehicle impacts, blasts or fires, has been tested using a model developed by structural engineers at the University of Surrey – with reassuring results.
Surrey's structural engineers partnered with industry experts to check and enhance the robustness of skyscrapers. Surrey's researchers collaborated with experts at the respected collective of architects, designers, engineers and planners, Skidmore, Owings & Merrill (SOM), famous for buildings like the Burj Khalifa, the world's tallest skyscraper, and the Sears ...
Inequities in cardiovascular care are putting older female’s heart health at risk
2023-08-30
Toronto, ON, August 30, 2023 – Higher stroke risk among females with atrial fibrillation may be related to sex-based disparities in cardiovascular care, according to a new study from Women’s College Hospital, the Peter Munk Cardiac Centre (PMCC) at University Health Network (UHN) and ICES.
Atrial fibrillation (AF) is a common type of irregular heart rhythm that is associated with a higher risk of stroke—after the age of 40, one in four strokes are caused by AF. Previous studies have found that female sex (assigned at birth) is a risk factor for AF-associated stroke. Recent research suggested that ...
Surprising study results: Students are bored during exams
2023-08-30
In the case of boredom, we think of many situations in life but intuitively not of exams. However, an international team of academics led by Thomas Götz from the University of Vienna has now studied exactly this phenomenon of test boredom for the first time and found remarkable results. According to the study, school students are actually very bored during exams. The study also showed that utter boredom has a negative effect on exam results. The research results have been published recently in the Journal of Educational Psychology.
Although boredom is currently a very intensively studied phenomenon, test boredom has so far been completely ignored ...
Study reveals important associations between gut microbiome and eczema in infancy
2023-08-30
Washington, D.C. – A new study has revealed important associations between the gut microbiome and eczema in infancy and has established the basis for the potential prevention and treatment of eczema via modulation of the gut microbiota. The study was published in mSystems, a journal of the American Society for Microbiology.
“The problem of eczema is increasing, and our study shows it could be a result of unwanted changes in the gut bacterial content. The first year of life could be a critical period to restore the gut bacteria to a more desirable composition,” said the study’s principal investigator ...
Adapting Ritalin® to tackle cocaine abuse
2023-08-30
Cocaine use continues to be a public health problem, yet despite concerted efforts, no drugs have been approved to resolve cocaine addiction. Research suggests that the attention-deficit/hyperactivity disorder drug methylphenidate (MPH; Ritalin®) could serve as a cocaine-replacement therapy, but clinical results have been mixed. Although several labs have produced MPH derivatives for testing, parts of the molecule remained chemically inaccessible. Now, researchers reporting in ACS Central Science have cleared that hurdle.
According to the Centers for Disease Control and Prevention, more than 5 million Americans ...
A new way to capture and recycle carbon dioxide from industrial emissions
2023-08-30
Carbon capture is a promising method to help slow climate change. With this approach, carbon dioxide (CO2) is trapped before it escapes into the atmosphere, but the process requires a large amount of energy and equipment. Now, researchers reporting in ACS Central Science have designed a capture system using an electrochemical cell that can easily grab and release CO2. The device operates at room temperature and requires less energy than conventional, amine-based carbon-capture systems.
Many industries are turning ...
Nuclear weapons tests are unappreciated source of radioactivity in German wild boars
2023-08-30
Shaggy-haired, tusked pigs roam free in the woods of Germany and Austria. Although these game animals look fine, some contain radioactive cesium at levels that render their meat unsafe to eat. Previously, scientists hypothesized that the contamination stemmed from the 1986 Chernobyl nuclear power plant accident. But now, researchers in ACS’ Environmental Science & Technology report that nuclear weapon fallout from 60 to 80 years ago also contributes significantly to the wild boars’ persistent radioactivity.
Radioactive cesium, a byproduct of nuclear weapons explosions and nuclear ...
ESO telescopes help unravel pulsar puzzle
2023-08-30
With a remarkable observational campaign that involved 12 telescopes both on the ground and in space, including three European Southern Observatory (ESO) facilities, astronomers have uncovered the strange behaviour of a pulsar, a super-fast-spinning dead star. This mysterious object is known to switch between two brightness modes almost constantly, something that until now has been an enigma. But astronomers have now found that sudden ejections of matter from the pulsar over very short periods are responsible for the peculiar switches.
“We have witnessed extraordinary cosmic events where enormous amounts of matter, similar to cosmic cannonballs, are launched into ...
Novel chemosensor-based method for rapid detection of bacterial toxin
2023-08-30
The COVID-19 pandemic made it very clear that we need better methods to quickly screen for dangerous pathogens and substances. One such compound that regularly flies under the radar is lipopolysaccharide (LPS), largely known as "endotoxins." This molecule, which is found in the outer membrane of Gram-negative bacteria, can be very harmful to humans. It can trigger a major immune response, producing fever and inflammation. In the worst cases, it can cause organ failure due to sepsis.
Surprisingly, for such a ubiquitously present toxin, there are very few ways to effectively detect the presence of LPS. The gold standard for its detection is the limulus amebocyte ...