The Basque Country is implementing Quantus Skin in its health clinics after an investment of 1.6 million euros. Specialists criticise the artificial intelligence developed by the Asisa subsidiary due to its “poor” and “dangerous” results. The algorithm has been trained only with data from white patients.
They absolutely have power over the data sets.
They could also fund research into other cancers and work with other countries like ones in Africa where there are more black people to sample.
It’s impossible to know intent but it does seem pretty intentionally eugenics of them to do this when it has been widely criticized and they refuse to fix it. So I’d say it is explicitly racist.
Eugenics??? That’s crazy.
So you’d prefer that they don’t even start working with this screening method until we have gathered enough data to satisfy everyones representation?
Let’s just do that and not do anything until everyone is happy. Nothing will happen ever and we will all collectively suffer.
How about this. Let’s let the people with the knowledge use this “racist” data and help move the bar for health forward for everyone.
It isn’t crazy and it’s the basis for bioethics, something I had to learn about when becoming a bioengineer who also worked with people who literally designed AI today and they continue to work with MIT, Google, and Stanford on machine learning… I have spoked extensively with these people about ethics and a large portion of any AI engineer’s job is literally just ethics. Actually, a lot of engineering is learning ethics and accidents - they go hand in hand, like the Hotel Hyatt collapse.
I never suggested they stop developing the screening technology, don’t strawman, it’s boring. I literally gave suggestions for how they can fix it and fix their data so it is no longer functioning as a tool of eugenics.
Different case below, but related sentiment that AI is NOT a separate entity from its creators/engineers and they ABSOLUTELY should be held liable for the outcomes of what they engineer regardless of provable intent.
https://lemmy.world/post/21189801/13055286
I know what bioethics is and how it applies to research and engineering. Your response doesn’t seem to really get to the core of what I’m saying: which is that the people making the AI tool aren’t racist.
Help me out: what do the researchers creating this AI screening tool in its current form (with racist data) have to do with it being a tool of eugenics? That’s quite a damning statement.
I’m assuming you have a much deeper understanding of what kind of data this AI screening tool uses and the finances and whatever else that goes into it. I feel that the whole “talk with Africa” to balance out the data is not great sounding and is overly simplified.
Do you really believe that the people who created this AI screening tool should be punished for using this racist data, regardless of provable intent? Even if it saved lives?
Does this kind of punishment apply to the doctor who used this unethical AI tool? His knowledge has to go into building it up somehow. Is he, by extension, a tool of eugenics too?
I understand ethical obligations and that we need higher standards moving forward in society. But even if the data right now is unethical, and it saves lives, we should absolutely use it.
I addressed that point by saying their intent to be racist or not is irrelevant when we focus on impact to the actual victims (ie systemic racism). Who cares about the individual engineer’s morality and thoughts when we have provable, measurable evidence of racial disparity that we can correct easily?
It literally allows black people to die and saves white people more. That’s eugenics.
It is fine to coordinate with universities in like Kenya, what are you talking about?
I never said shit about the makers of THIS tool being punished! Learn to read! I said the tool needs fixed!
Like seriously you are constantly taking the position of the white male, empathizing, then running interference for him as if he was you and as if I’m your mommy about to spank you. Stop being weird and projecting your bullshit.
Yes, doctors who use this tool on their black patients and white patients equally would be perofmring eugenics, just like the doctors who sterikized indigenous women because they were poor were doing the same. Again, intent and your ego isn’t relevanf when we focus on impacts to victims and how to help them.
We should demand they work in a very meaningful way to get the data to be as good for black people as their #1 priority, ie doing studies and collecting that data