I dont see why it should be difficult to debug unless you think this is all some kind of conspiratorial plot by white people or the "white system" who are all secretely racist against black people and that's why the detection rate was purposefully kept low by these evil people.
And implying that we have to be irrational to be ethical is also pretty weird.
It's not a "conspiratorial plot", no. But time and again, research has shown that the implicit biases held by the people building these tools [0] are observable in the tool's results — and all people hold implicit biases.
It's not the tool we need to debug; it's us.
[0] Where, by "these tools", I mean machine learning writ large.
EDIT: I highly doubt your comment's parent was suggesting we had to be irrational in order to be ethical. Rather, I believe they meant we should be rational and ethical. Wouldn't you agree?
