There is a problem with people working cash in hand for less than minimum wage which hasn't been dealt with effectively.
The bigger issue relating to freedom of movement is that there is now a workforce available to employers, largely from Eastern Europe, who will work long hours for low wages...