The answer is ignorent people and you cant fix that.For example If a player is bad then it dosent matter what colour he is,hes bad.If a player is good,again it dosent matter what colour he is,hes good and if a player plays for the team that you support then he should be untouchable.
So,as I said,its driven by ignorance.