(Press-News.org) Increasingly, businesses rely on algorithms that use data provided by users to make decisions that affect people. For example, Amazon, Google, and Facebook use algorithms to tailor what users see, and Uber and Lyft use them to match passengers with drivers and set prices. Do users, customers, employees, and others have a right to know how companies that use algorithms make their decisions? In a new analysis, researchers explore the moral and ethical foundations to such a right. They conclude that the right to such an explanation is a moral right, then address how companies might do so.
The analysis, by researchers at Carnegie Mellon University, appears in Business Ethics Quarterly, a publication of the Society for Business Ethics.
"In most cases, companies do not offer any explanation about how they gain access to users' profiles, from where they collect the data, and with whom they trade their data," explains Tae Wan Kim, Associate Professor of Business Ethics at Carnegie Mellon University's Tepper School of Business, who co-wrote the analysis. "It's not just fairness that's at stake; it's also trust."
In response to the rise of autonomous decision-making algorithms and their reliance on data provided by users, a growing number of computer scientists and governmental bodies have called for transparency under the broad concept of algorithmic accountability. For example, the European Parliament and the Council of the European Union adopted the General Data Protection Regulation (GDPR) in 2016, part of which regulates the use of automatic algorithmic decision systems. The GDPR, which launched in 2018, affects businesses that process the personally identifiable information of residents of the European Union.
But the GDPR is ambiguous about whether it involves a right to explanation regarding how businesses' automated algorithmic profiling systems reach decisions. In this analysis, the authors develop a moral argument that can serve as a foundation for a legally recognized version of this right.
In the digital era, the authors write, some say that informed consent--obtaining prior permission for disclosing information with full knowledge of the possible consequences--is no longer possible because many digital transactions are ongoing. Instead, the authors conceptualize informed consent as an assurance of trust for incomplete algorithmic processes.
Obtaining informed consent, especially when companies collect and process personal data, is ethically required unless overridden for specific, acceptable reasons, the authors argue. Moreover, informed consent in the context of algorithmic decision-making, especially for non-contextual and unpredictable uses, is incomplete without an assurance of trust.
In this context, the authors conclude, companies have a moral duty to provide an explanation not just before automated decision making occurs, but also afterward, so the explanation can address both system functionality and the rationale of a specific decision.
The authors also delve into how companies that run businesses based on algorithms can provide explanations of their use in a way that attracts clients while maintaining trade secrets. This is an important decision for many modern start-ups, including such questions as to how much code should be open source, and how extensive and exposed the application program interface should be.
Many companies are already tackling these challenges, the authors note. Some may choose to hire "data interpreters," employees who bridge the work of data scientists and the people affected by the companies' decisions.
"Will requiring an algorithm to be interpretable or explainable hinder businesses' performance or lead to better results?" asks Bryan R. Routledge, Associate Professor of Finance at Carnegie Mellon's Tepper School of Business, who co-wrote the analysis. "That is something we'll see play out in the near future, much like the transparency conflict of Apple and Facebook. But more importantly, the right to explanation is an ethical obligation apart from bottom-line impact."
INFORMATION:
Scientists at the National Institutes of Health determined that stomach inflammation is regulated differently in male and female mice after finding that androgens, or male sex hormones, play a critical role in preventing inflammation in the stomach. The finding suggests that physicians could consider treating male patients with stomach inflammation differently than female patients with the same condition. The study was published in Gastroenterology.
Researchers at NIH's National Institute of Environmental Health Sciences (NIEHS) made the discovery after removing adrenal glands from mice of both sexes. Adrenal glands produce glucocorticoids, hormones that have several functions, one of them being suppressing inflammation. With no glucocorticoids, the female mice soon ...
In 1961, the Nobel prize winning theoretical physicist Eugene Wigner proposed what is now known as the Wigner's friend thought experiment as an extension of the notorious Schroedinger's cat experiment. In the latter, a cat is trapped in a box with poison that will be released if a radioactive atom decays. Governed by quantum mechanical laws, the radioactive atom is in a superposition between decaying and not decaying, which also means that the cat is in a superposition between life and death. What does the cat experience when it is in the superposition? ...
A study led by LMU plant biologist Hans-Henning Kunz uncovers a new role for ion transporters: they participate in gene regulation in chloroplasts.
In plants, photosynthesis takes place in intracellular 'factories' called chloroplasts. Plant chloroplasts evolved from photosynthetic cyanobacteria, which were engulfed by a non-photosynthetic cell in the course of evolution. As a result of this evolutionary event, chloroplasts possess two envelope membranes, and have retained functional remnants of their original cyanobacterial genomes. Henning Kunz (LMU Biocenter), his group, and their collaborators have now demonstrated that ...
Input one, output one; input two, output two; input three; output purple --what kind of system is this? Computer algorithms can exist as non-deterministic systems, in which there are multiple possible outcomes for each input. Even if one output is more likely than another, it doesn't necessarily eliminate the possibility of putting in three and getting purple instead of three. Now, a research team from Iowa State University has developed a way to control such systems with more predictability. The results were published in IEEE/CAA Journal of Automatica Sinica.
"The supervisory control problem for discrete event systems under control involves ...
The ability to visualize transparent objects such as biological cells is of fundamental importance in biology and medical diagnostics. Conventional approaches to achieve this include phase-contrast microscopy and techniques that rely on chemical staining of biological cells. These techniques, however, rely on expensive and bulky optical components or require changing, and in some cases damaging, the cell by introducing chemical contrast agents. Significant recent advances in nanofabrication technology permit structuring materials on the nanoscale with unprecedented ...
Australian researchers have documented the diversity of cells in the human breast, explaining the relationship between healthy breast cells and breast cancer cells.
The research, which relied on expertise spanning from breast cancer biology through to bioinformatics, measured gene expression in single cells taken from healthy women and cancerous breast tissue, including tissue carrying a faulty BRCA1 gene. This enabled the researchers to create an 'RNA atlas' that details the different cells found in these tissues.
The atlas, which was described in EMBO Journal, ...
Japanese researchers successfully tested reflectionless, highly refractive index metasurface that may eventually be used in practical applications to send, receive, and manipulate light and radio waves in the terahertz waveband (THz). THz is measured in millionths of a meter, known as micrometers. The metasurface, an artificial two-dimensional flat material, was made of micro-sized cut metal wires of silver paste ink placed on both the front and back of a polyimide film. The team, led by Takehito Suzuki, Associate Professor at the Tokyo University of Agriculture and Technology (TUAT) Institute of Engineering, published their findings on April 29, 2021 in Optics Express.
Such flat metasurfaces ...
Psychology researchers at UC Santa Cruz have found that playing games in virtual reality creates an effect called "time compression," where time goes by faster than you think. Grayson Mullen, who was a cognitive science undergraduate at the time, worked with Psychology Professor Nicolas Davidenko to design an experiment that tested how virtual reality's effects on a game player's sense of time differ from those of conventional monitors. The results are now published in the journal Timing & Time Perception.
Mullen designed a maze game that could be played in both virtual reality and conventional formats, then the research team recruited 41 UC Santa Cruz undergraduate ...
The COVID-19 pandemic has been shown to have caused a significant strain on the healthcare system and resources in the United States. However, data regarding the impact of the virus on hip fractures, primarily seen in elderly patients, is lacking.
Researchers at Hospital for Special Surgery (HSS) sought to compare characteristics and outcomes of hip fracture patients admitted during the COVID-19 outbreak to patients admitted before the outbreak. They also examined characteristics and outcomes of hip fracture patients with and without the virus. Their findings were presented at the 2021 Spring American Society of Regional Anesthesia and ...
Interim results of a study conducted by researchers at Hospital for Special Surgery (HSS) suggest that oral tranexamic acid (TXA) is non-inferior to intravenous (IV) TXA in preventing blood loss in total knee and total hip replacement surgery. These findings were presented at the 2021 Spring American Society of Regional Anesthesia and Pain Medicine (ASRA) Annual Meeting.1
Previously available information suggests that oral, IV and topical TXA are all effective at reducing blood loss and drastically reducing blood transfusion rates during and after surgery, but research with direct comparisons for each method is limited.
"TXA in orthopedic surgery has become the standard ...
