Breakthrough model utilizes movie-watching FMRI and eye-tracking to predict cognitive scores
2023-09-16
(Press-News.org)
In a recent article published in Volume 3 of the journal Psychoradiology, researchers from Northwestern Polytechnical University have unveiled the groundbreaking "Attention-CensNet" (A-CensNet), a fusion model that predicts cognitive scores by amalgamating movie-watching functional magnetic resonance imaging (mfMRI) and eye-tracking data. In this model, participants serve as nodes, mfMRI data are translated into node features, and eye-tracking details forge the connections between participants, creating graph edges. By employing multiple graphs as channels, A-CensNet merges graph embeddings to offer a consolidated interpretation. Remarkably, A-CensNet outperforms models based solely on individual modalities and other leading techniques, underscoring the synergy between brain functionality and behavior in gauging cognitive traits. This synergy is not only pivotal for understanding cognitive aberrations and potential psychiatric markers but also suggests potential in diagnosing disorders like autism, characterized by attention disparities. Although initial tests on emotion scores were less definitive, the incorporation of advanced algorithms, such as LSTM and BERT, in future iterations may enhance predictions.
While the model is primarily tailored for movie-watching, its application isn't limited. Combining other modalities like resting-state fMRI could predict other personal traits. Most importantly, integrating varied data sources as shown in this study can amplify cognitive prediction accuracy, crucial for distinguishing between patients and controls in disease research.
###
References
DOI
10.1093/psyrad/kkad011
Funding information
The National Natural Science Foundation of China (31971288, U1801265, 61936007, 62276050, 61976045, U20B2065, U1801265 and 61936007); The National Key R&D Program of China under Grant 2020AAA0105701; High-level researcher start-up projects (06100–22GH0202178); Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University (CX2022052).
About Psychoradiology
Psychoradiology is an open-access journal co-published byOxford University Press and West China Hospital. lt has been indexed byScopus and DOAJ, and the APC is waived during its early stage. We welcomeinterdisciplinary submissions in the fields of radiology, psychology,psychiatry, neurology and neuroscience, as well as medicalimaging,interventional medicine, artificial intelligence, and computer science, etc.Afast-track production mode will be adopted to ensure the manuscript ispublished as soon as possible.
END
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
2023-09-16
Fatty liver disease is a condition characterised by a build-up of fat in the liver and is the most common chronic liver disease that affects over one billion people. Over time, this can lead to complications including cirrhosis, liver failure, liver cancer, and heart health issues. The disease is now known as metabolic (dysfunction) associated fatty liver disease (MAFLD). This is because the disease is now understood to be linked to metabolic factors, such as obesity, insulin resistance, and diabetes.
MAFLD is a multisystem disorder with a heterogeneous disease course and outcomes. This means that it can affect multiple organs, and the course of the disease can vary from person ...
2023-09-16
Most artificially intelligent systems are based on neural networks, algorithms inspired by biological neurons found in the brain. These networks can consist of multiple layers, with inputs coming in one side and outputs going out of the other. The outputs can be used to make automatic decisions, for example, in driverless cars. Attacks to mislead a neural network can involve exploiting vulnerabilities in the input layers, but typically only the initial input layer is considered when engineering a defense. For the first time, researchers augmented a neural network’s inner layers with a process involving random noise to improve its resilience.
Artificial intelligence (AI) ...
2023-09-16
Scientists have used genomics to reveal distinct sexual networks for syphilis transmission, defined geographically or by sexual preference, among a background of wider circulation in England. They also show a presence of drug resistance in the majority of cases.
By grouping closely related strains of the bacterium that causes syphilis – Treponema pallidum –, researchers demonstrate how a large number of cases are linked together. Researchers from the Wellcome Sanger Institute and their collaborators at the UK Health Security Agency (UKHSA)* sequenced ...
2023-09-15
Images
Highlights:
The U.S. Department of Energy Office of Science, or DOE-SC, is investing in machine learning, a type of artificial intelligence, to accelerate the speed of research and development in nuclear science. Michigan State University researchers at the Facility for Rare Isotope Beams, or FRIB, are leading five of these new grant projects.
These projects aim to enhance the breadth of FRIB’s activities, covering nuclear physics experiments and theory, as well as particle accelerator operations.
FRIB is a DOE-SC user facility, meaning that these advances will serve ...
2023-09-15
The University of Kentucky Markey Cancer Center announced today that it has earned a National Cancer Institute “Comprehensive” Cancer Center designation, the highest level of recognition awarded by the NCI. Markey is the first and only center in Kentucky to achieve this designation, and the next-closest Comprehensive Cancer Center is nearly 200 miles from Lexington. There are currently only 72 NCI-Designated Cancer Centers in the country, and 56 of those are Comprehensive Cancer Centers.
As the federal government’s principal ...
2023-09-15
Ratings on platforms such as Yelp and TripAdvisor can greatly impact high-priced New York City restaurants that service tourists, but have less of an effect on restaurants frequented by “locals” outside of tourist areas, according to new Cornell research.
“In neighborhoods frequented by ‘locals,’ the advent and expansion of internet-based ratings platforms did not result in greater disparities in restaurant sales despite how ubiquitous they are and how frequently we anecdotally use them,” said Jason Greenberg, associate ...
2023-09-15
The feel of a cat’s fur can reveal some information, but seeing the feline provides critical details: is it a housecat or a lion? While the sound of fire crackling may be ambiguous, its scent confirms the burning wood. Our senses synergize to give a comprehensive understanding, particularly when individual signals are subtle. The collective sum of biological inputs can be greater than their individual contributions. Robots tend to follow more straightforward addition, but Penn State researchers have now harnessed the biological concept for application in artificial intelligence (AI) to develop ...
2023-09-15
Genetically speaking, we are individuals different from each other because of slight variations in our DNA sequences – so-called genetic variants – some of which have dramatic effects we can see and comprehend, from the color of our eyes to our risk for developing schizophrenia – a debilitating psychiatric condition affecting many millions worldwide. For several years, scientists have studied the entire genomes of thousands of people – called genome-wide association studies, or GWAS – to find approximately 5,000 genetic variants associated with schizophrenia.
Now, ...
2023-09-15
Rochester Institute of Technology scientists have once again used data from the James Webb Space Telescope (JWST) as part of the Cosmic Evolution Early Release Science (CEERS) Survey to change the way we think about the universe and its distant galaxies.
Jeyhan Kartaltepe, associate professor in the School of Physics and Astronomy, and Rebecca Larson, postdoctoral research associate, co-authored a paper, “Confirmation and refutation of very luminous galaxies in the early Universe,” published in Nature confirming ...
2023-09-15
Researchers from Western and Brown University have made groundbreaking progress towards identifying the root cause and potential therapy for preeclampsia.
The pregnancy complication affects up to eight per cent of pregnancies globally and is the leading cause of maternal and fetal mortality due to premature delivery, complications with the placenta and lack of oxygen.
The research, led by Drs. Kun Ping Lu and Xiao Zhen Zhou at Western, and Drs. Surendra Sharma and Sukanta Jash at Brown, has identified ...
LAST 30 PRESS RELEASES:
[Press-News.org] Breakthrough model utilizes movie-watching FMRI and eye-tracking to predict cognitive scores
