Sometimes I get angry at refs, but it's more at the rules they're having to enforce that I think are stupid. Unfortunately they're the ones in the firing line and so bear the brunt of my exasperation in the heat of the moment.
*That's not to say they can't make terrible decisions as well.