Scardey, I think you are falling for the “all else equal” fallacy.
If all else between the two men is identical but the color of their skin. Meaning they have the same clothing, mannerisms, facial expressions, etc. I doubt many would judge the runners differently.
Now the questions is are some of those other characteristics fair to judge on. Seems to me, sometimes yes, sometimes no. Hows that for muddying the waters.