DeepMB: a deep learning framework for high-quality optoacoustic imaging in real-time

(Press-News.org) Researchers at Helmholtz Munich and the Technical University of Munich have made significant progress in advancing high-resolution optoacoustic imaging for clinical use. Their innovative deep-learning framework, known as DeepMB, holds great promise for patients dealing with a range of illnesses, including breast cancer, Duchenne muscular dystrophy, and inflammatory bowel disease. Their findings have been now published in Nature Machine Intelligence.

In order to understand and detect diseases scientists and medical staff often rely on imaging methods such as ultrasound or X-ray. However, depending on the tissue the resolution and depth of the resulting image is limited or insufficient. A relatively new method called optoacoustic imaging combines the principles of both ultrasound and laser-induced optical imaging and is, therefore, a powerful medical imaging tool to non-invasively assess a wide variety of diseases, including breast cancer, Duchenne muscular dystrophy, inflammatory bowel disease, and many more. This technology would greatly benefit patients in the clinic, however, its practical use is hampered because high-quality images require prohibitively long processing times. A team of researchers from the Bioengineering Center and the Computational Health Center at Helmholtz Munich and the Technical University of Munich have developed a deep-learning framework (DeepMB) allowing clinicians to obtain high-quality optoacoustic images in real-time, a major step towards the clinical translation of this technology.

The research focuses on multispectral optoacoustic tomography (MSOT), an optoacoustic imaging method developed by Prof. Ntziachristos and his research team at Helmholtz Munich and the Technical University of Munich, distributed by and continuously jointly advanced together with his spin-off company, iThera Medical GmbH. An MSOT scanner works by taking advantage of the optoacoustic effect, where sound waves are generated when light is absorbed by a material. The instrument collects these sound waves, which are translated into images displayed on the scanner monitor with the help of so-called reconstruction algorithms. Unfortunately, the simpler algorithms that can reconstruct images quickly enough to display them in real-time can only deliver low-quality images, while the more complex algorithms that can produce high-quality images take far longer than what would be practical in a clinical setting.

Optoacoustic Imaging Accelerated for Faster Results Without Compromising Image Quality

The new neural network DeepMB is capable of reconstructing high-quality optoacoustic images about a thousand times faster than the state-of-the-art algorithm with virtually no loss in image quality. The critical innovation unlocking this achievement was the training strategy used for DeepMB. The training strategy was based on optoacoustic signals synthesized from various pictures of the real world paired with optoacoustic images reconstructed from the corresponding signals. The resulting framework also overcomes one of artificial intelligence's (AI) major challenges: generalization. This means that DeepMB can accurately reconstruct all scans acquired from any patient, regardless of the part of the body being targeted or the disease being analyzed. 

Facilitating the Clinical Application of Optoacoustic Tomography

By using DeepMB, clinicians will have direct access to optimal MSOT image quality for the first time. This represents a major leap forward for this technology, positively impacting clinical studies and ultimately helping patients receive better care. The core principles of DeepMB are also readily adaptable and can be applied to many other reconstruction methods in optoacoustic imaging, including other research efforts at Helmholtz Munich. More broadly, the researchers believe this framework can also be applied to other imaging modalities such as ultrasound, X-ray, or magnetic resonance imaging (MRI).

About the scientists

Prof. Dr. Vasilis Ntziachristos, Director at the Institute for Biological and Medical Imaging and Director of the Bioengineering Department at Helmholtz Munich and Professor for Biological Imaging at the Technical University of Munich (TUM) 

Dr. Dominik Jüstel, Group Leader at the Institute of Biological and Medical Imaging at Helmholtz Munich and at the Chair of Biological Imaging at the Technical University of Munich (TUM) 

About Helmholtz Munich:

Helmholtz Munich is a leading biomedical research center. Its mission is to develop breakthrough solutions for better health in a rapidly changing world. Interdisciplinary research teams focus on environmentally triggered diseases, especially the therapy and prevention of diabetes, obesity, allergies, and chronic lung diseases. With the power of artificial intelligence and bioengineering, researchers accelerate the translation to patients. Helmholtz Munich has more than 2,500 employees and is headquartered in Munich/Neuherberg. It is a member of the Helmholtz Association, with more than 43,000 employees and 18 research centers the largest scientific organization in Germany. More about Helmholtz Munich (Helmholtz Zentrum München Deutsches Forschungszentrum für Gesundheit und Umwelt GmbH): www.helmholtz-munich.de/en     

END