Nobody voted for that. The brexit vote and implementation of it are two separate things and conflating them as one isn't helpful, it plays into the silly argument that everything is or isn't down to EU membership.
So, move on from the yes / no and rightly hold the Tories feet to the fire that...