I think wearing team colours (not necessarily replica shirts) adds to the ocassion and atmosphere.
I would rather see middle aged men at games in City shirt rather than whatever has replaced burberry as the latest brand of choice of wannabe hooligan chavs.