Omitting race and ethnicity from colorectal cancer (CRC) recurrence danger prediction fashions might lower their accuracy and equity, notably for minority teams, doubtlessly resulting in inappropriate care recommendation and contributing to present well being disparities, new analysis suggests.
“Our examine has necessary implications for creating scientific algorithms which are each correct and truthful,” write first writer Sara Khor, MASc, with College of Washington, Seattle, and colleagues.
“Many teams have referred to as for the removing of race in scientific algorithms,” Khor advised Medscape Medical Information. “We wished to raised perceive, utilizing CRC recurrence as a case examine, what a number of the implications is likely to be if we merely take away race as a predictor in a danger prediction algorithm.”
Their findings recommend that doing so might result in larger racial bias in mannequin accuracy and fewer correct estimation of danger for racial and ethnic minority teams. This might result in insufficient or inappropriate surveillance and follow-up care extra usually in sufferers of minoritized racial and ethnic teams.
The examine was published online June 15 in JAMA Community Open.
Lack of Knowledge and Consensus
There’s at the moment a scarcity of consensus on whether or not and the way race and ethnicity ought to be included in scientific danger prediction fashions used to information healthcare selections, the authors observe.
The inclusion of race and ethnicity in scientific danger prediction algorithms has come beneath elevated scrutiny, as a result of issues over the potential for racial profiling and biased remedy. However, some argue that excluding race and ethnicity might hurt all teams by lowering predictive accuracy and would particularly drawback minority teams.
But, it stays unclear whether or not merely omitting race and ethnicity from algorithms will in the end enhance care selections for sufferers of minoritized racial and ethnic teams.
Khor and colleagues investigated the efficiency of 4 danger prediction fashions for CRC recurrence utilizing information from 4230 sufferers with CRC (53% non-Hispanic white; 22% Hispanic; 13% Black or African American; and 12% Asian, Hawaiian, or Pacific Islander).
The 4 fashions had been: (1) a race-neutral mannequin that explicitly excluded race and ethnicity as a predictor; (2) a race-sensitive mannequin that included race and ethnicity; (3) a mannequin with two-way interactions between scientific predictors and race and ethnicity; and (4) separate fashions stratified by race and ethnicity.
They discovered that the race-neutral mannequin had poorer efficiency (worse calibration, damaging predictive worth, and false-negative charges) amongst racial and ethnic minority subgroups in contrast with non-Hispanic white. The false-negative price for Hispanic sufferers was 12% vs 3% for non-Hispanic white sufferers.
Conversely, together with race and ethnicity as a predictor of postoperative most cancers recurrence improved the mannequin’s accuracy and elevated “algorithmic equity” when it comes to calibration slope, discriminative potential, constructive predictive worth, and false-negative charges. The false-negative price for Hispanic sufferers was 9% and eight% for non-Hispanic white sufferers.
The inclusion of race interplay phrases or utilizing race-stratified fashions didn’t enhance mannequin equity, seemingly as a result of small pattern sizes in subgroups, the authors add.
‘No One-Measurement-Matches-All Reply’
“There isn’t a one-size-fits-all reply as to if race/ethnicity ought to be included, as a result of the well being disparity penalties that may end result from every scientific resolution are completely different,” Khor advised Medscape Medical Information.
“The downstream harms and advantages of together with or excluding race will have to be fastidiously thought-about in every case,” Khor mentioned.
“When creating a scientific danger prediction algorithm, one ought to contemplate the potential racial/ethnic biases current in scientific follow, which translate to bias within the information,” Khor added. “Care should be taken to suppose by means of the implications of such biases through the algorithm growth and analysis course of so as to keep away from additional propagating these biases.”
The co-authors of a linked commentary say this examine “highlights present challenges in measuring and addressing algorithmic bias, with implications for each affected person care and well being coverage decision-making.”
Ankur Pandya, PhD, with Harvard T.H. Chan College of Public Well being, Boston, Massachusetts, and Jinyi Zhu, PhD, with Vanderbilt College College of Drugs, Nashville, Tennessee, agree that there isn’t a “one-size-fits-all resolution” — corresponding to all the time excluding race and ethnicity from danger fashions — to confronting algorithmic bias.
“When doable, approaches for figuring out and responding to algorithmic bias ought to concentrate on the selections made by sufferers and policymakers as they relate to the final word outcomes of curiosity (corresponding to size of life, high quality of life, and prices) and the distribution of those outcomes throughout the subgroups that outline necessary well being disparities,” Pandya and Zhu recommend.
“What’s most promising,” they write, is the excessive degree of engagement from researchers, philosophers, policymakers, physicians and different healthcare professionals, caregivers, and sufferers to this trigger lately, “suggesting that algorithmic bias won’t be left unchecked as entry to unprecedented quantities of knowledge and strategies continues to extend shifting ahead.”
This analysis was supported by a grant from the Nationwide Most cancers Institute of the Nationwide Institutes of Well being. The authors and editorial writers have disclosed no related monetary relationships.
JAMA Netw Open. 2023;6(6):e2318495, e2318501. Full text, Commentary
For extra information, observe Medscape on Facebook, Twitter, Instagram, and YouTube.
