Perhaps that is because we can identify the implicit and explicit biases, power structures, and environmental issues that are in front of our faces, and that there are more differences that can be explained by them than by biological causes.
Yes, I hear you on this. It's the old nature vs nurture debate. And the leftist orthodoxy is against any theory, finding or research that would assign some non-trivial level of blame to nature. My beef is that the left, who like consider them pro-science, can at times be just as anti-science as the right.