I agree. I think the blocks of flats/tower blocks are the most brutalist structures we built. Most of it in the city centre I'd just call modernist.
There are some that could be brutalist like the car park opposite White St, but has been given a brick facade to hide the concrete structure. But then I suppose you could argue the same about he cathedral.