(Press-News.org) The researchers challenge the widespread belief that AI-induced bias is a technical flaw, arguing instead AI is deeply influenced by societal power dynamics. It learns from historical data shaped by human biases ,absorbing and perpetuating discrimination in the process. This means that, rather than creating inequality, AI reproduces and reinforces it.
“Our study highlights real-world examples where AI has reinforced existing biases.” Prof. Bircan says. “One striking case is Amazon’s AI-driven hiring tool, which was found to favor male candidates, ultimately reinforcing gender disparities in the job market. Similarly, government AI fraud detection systems have wrongly accused families, particularly migrants, of fraud, leading to severe consequences for those affected. These cases demonstrate how AI, rather than eliminating bias, can end up amplifying discrimination when left unchecked. Without transparency and accountability, AI risks becoming a tool that entrenches existing social hierarchies rather than challenging them.”
AI is developed within a broader ecosystem where companies, developers, and policymakers make critical decisions about its design and use. These choices determine whether AI reduces or worsens inequality. When trained on data reflecting societal biases, AI systems replicate discrimination in high-stakes areas like hiring, policing, and welfare distribution. Professor Bircan’s research stresses that AI governance must extend beyond tech companies and developers. Given that AI relies on user-generated data, there must be greater transparency and inclusivity in how it is designed, deployed and regulated. Otherwise, AI will continue to deepen the digital divide and widen socio-economic disparities.
Despite the challenges, the study also offers hope. “Rather than accepting AI’s flaws as inevitable, our work advocates for proactive policies and frameworks that ensure AI serves social justice rather than undermining it. By embedding fairness and accountabilit into AI from the start, we can harness its potential for positive change rather than allowing it to reinforce systemic inequalities.” Prof. Bircan concludes.
Reference:
Tuba Bircan, Mustafa F. Özbilgin, (2025) Unmasking inequalities of the code: Disentangling the nexus of AI and inequality. Technological Forecasting and Social Change, Volume 211, 123925. https://doi.org/10.1016/j.techfore.2024.123925.
END
Unmasking inequalities in AI: new research reveals how artificial intelligence might reinforce inequality
2025-02-27
ELSE PRESS RELEASES FROM THIS DATE:
Taking sports science in her stride: How Dr. Nerea Casal García aims to maximize performance on the track
2025-02-27
The following is a Q&A with Dr Nerea Casal García, a sports scientist focusing on sports training and performance optimization. To speak to the author, or to receive an advance copy of the paper, please write to: press@frontiersin.org The paper will be published on 27 Feb 2025 06:15 CET]
Dr Nerea Casal García is an athlete, personal coach, and injury readaptation specialist who last year completed a PhD on observational analysis in elite sports. Today, she is a professor at the Institut Nacional ...
Pioneering work generates feline embryonic stem cells in boon for cats
2025-02-27
As different as they may seem, humans and cats have similar ailments, but in terms of health care, veterinary regenerative medicine is not as advanced.
A possible solution rests in embryonic stem cells, which can differentiate into various types of cells and be transplanted to restore internal damage. Further, they are characterized by their near-natural state similar to induced pluripotent stem (iPS) cells. Recent research has successfully generated feline iPS cells, but not embryonic stem cells, so research on these cell lines is essential to improve the quality ...
Decoding the link between colorectal cancer risk and steatotic liver disease
2025-02-27
Alcoholic and non-alcoholic fatty liver disease (NAFLD) are well-known risk factors for colorectal cancer (CRC). NAFLD has emerged as a heterogenous disease tightly linked to metabolic dysfunction and has been redefined under the umbrella term ‘steatotic liver disease’ (SLD). However, CRC risk variations across different SLD subgroups remain unknown. Now, researchers from Japan have discovered that the risk of CRC varies significantly among SLD subgroups, with patients with alcoholic liver disease being at higher risk.
Lifestyle-related disorders have become increasingly prevalent, representing a major health ...
Controlling conformational changes in protein aromatic side chains
2025-02-27
Novel protein cage system can control and visualize orientational changes in aromatic side chains upon ligand binding, as reported by researchers at Institute of Science Tokyo. By inducing coordinated molecular changes, this approach enables precise control over protein dynamics while also enhancing fluorescence properties. Their breakthrough could lead to applications in biomolecular robotics, drug delivery, and advancing the development of responsive biomaterials.
The dynamic nature of proteins—their ability to bend, fold, and change shape in response to their environment—underlies ...
Experimental and numerical analysis of the potential drop method for defects caused by dynamic loads
2025-02-27
In our paper “Experimental and Numerical Analysis of the Potential Drop Method for Defects Caused by Dynamic Loads”, we investigate how the electrodynamic proximity effect can be utilized to enhance the defect sensitivity of PDM in SHM applications by proper arrangement of the measurement setup. We showed how eddy current effects present in our PDM setup can be modeled analytically and numerically. Lock-in technique and the application of the skin effect allow high- resolution impedance ...
Chinese researchers make breakthrough in artificial chiral structural-color microdomes
2025-02-27
Chiral-structural-color materials produce color through microscopic structures that interact with light rather than through pigmentation or dyes. Some beetle exoskeletons, avian feathers, butterfly wings, and marine organisms feature these structures naturally, producing iridescent or polarization-dependent colors. Over the last 10–15 years, scientists have made progress in developing artificial chiral-structural-color materials.
Recently, Chinese researchers have made a breakthrough in the field by discovering that microdomes made from common polymers exhibit tunable chiral structural colors with broad-spectrum capabilities and multiple ...
Intermittent fasting inhibits platelet activation to reduce thrombosis risk
2025-02-27
Cardiovascular diseases remain a leading cause of death worldwide, with platelet hyperactivity and subsequent thrombosis playing a pivotal role in these conditions. While intermittent fasting has long been recognized for its metabolic benefits, including improvements in metabolic diseases, weight loss, and even lifespan extension, its effect on platelet activation and thrombosis formation remains less understood.
A recent study by Professor Junbo Ge team at Fudan University unveiled a novel mechanism by which intermittent fasting can significantly reduce the risk of platelet hyperactivity and thrombosis. That is, intermittent fasting elevates levels of the metabolite ...
A clear game-changer: Curtin’s water-repellent glass breaks new ground
2025-02-27
Curtin University researchers have developed a new technique to make glass water-repellent, a feature that could improve safety in vehicles, reduce cleaning costs for buildings and enhance filtration systems.
The research, published in the prestigious journal Advanced Functional Materials, shows how an innovative and non-toxic process using ultrasonic sound waves can alter the surface of glass, making it either hydrophobic (water resistant) or electrically charged.
Lead researcher Associate Professor Nadim Darwish, an ARC Future Fellow at Curtin’s ...
Are our refrigerants safe? The lingering questions about the chemicals keeping us cool
2025-02-27
A team of scientists at UNSW has discovered that some of the most important new refrigerants break down, in part, into persistent greenhouse gas pollutants, including compounds that have been banned internationally. Refrigerants are chemicals that turn from a liquid to a gas – and vice-versa – and transfer heat in the process, that are used for refrigeration and indoor heating and cooling. The chemicals are also used as aerosol propellants, fire retardants and in the manufacture of foamed plastics.
Hydrofluoroolefins (HFOs), which react rapidly in the lower atmosphere, have emerged as the lead synthetic chemical for refrigerants, and are considered a more environmentally friendly ...
How nitrogen reshapes root system architecture in plants?
2025-02-27
In soil, nitrogen (N), an essential macronutrient for plant growth, exhibits significant spatial heterogeneity. This necessitates plants to grapple with a complex array of environmental conditions in their quest for N sustenance. Roots, as the pivotal organs in N acquisition, manifest a remarkable morphological plasticity, including variations in the length and density of primary roots, lateral roots, and root hairs, in response to the form and content of available N, which is termed N-dependent root system architecture (RSA). For cultivated crops, the ...