Viewing a single comment thread. View all comments

rogert2 t1_jb39f47 wrote

This is a really good idea.

Human doctors have a worse detection rate than you'd want, but not for the reason you'd think: they aren't incompetent, it's that humans are really bad at recognition tasks when the thing they are looking for is rare.

To illustrate: if I gave you 5 x-rays and told you that exactly one of them definitely has cancer, you'll find it. But if I give you 500 x-rays and zero promises about whether any of them have cancer, you'll be less reliable.

This is true whether or not the human is tired from a "long shift." It has to do with the way humans pay attention, and how our expectations influence what we observe. False-negatives go down as the sample size gets lower, or if the incidence increases. If 1% of the 500 x-rays have cancer, a human may only spot 3 or 4 of the 5. But if there are 50 with cancer, the human detection rate increases.

AI won't have this problem.

(Source: an intro psych class I took, which actually used breast-cancer detection as the vehicle for studying human attention.)

10

Lydiafae t1_jb4rna6 wrote

It also tracks that many doctors minimize or dismiss women's health issues. AI would prevent more of this bias, which would lead to more accurate health diagnostic metrics. Which I am all for given my personal experience.

0

ixM t1_jb5n6qp wrote

This is wrong. Because datasets are collected by humans they suffer from lots of different biases that are really hard to identify and remove. It's becoming a huge research topic.

1

rogert2 t1_jb7pd81 wrote

I don't think that "doctors dismissing patients concerns" is a source of failure to detect breast cancer via mammograms.

I assume women generally get mammograms because health experts recommend regular checks for all women. The reason radiologists fail to detect breast cancer in some x-rays is not that they aren't taking women seriously, because the women weren't coming in with symptoms or complaints -- they came in for a preventative screening. Radiologists sometimes fail to detect breast cancer because each radiologist looks at thousands of essentially identical x-rays over their career, breast cancer is uncommon, and cancer that does exist is hard to visually recognize in its early stages.

I'm not saying that people don't dismiss the complaints of women, whether in a healthcare or other context. But that's not what's going on here, because breast cancer checks are generally driven by prevention rather than symptoms.

1