I think you underestimate the effect a poor official can have on a team!
You get the frustration which can bring out the worst in anyone.
You get the feeling of unjust and think what's the point the game is gone!
You get the doubt in your head. If he goes down will I get booked?? Etc.
The effect is massive