well seen as they haven't been able to agree a deal with the EU despite 11 years of negotiation I'd say it pretty much is a deal breaker.
The visa issue, I think, is mainly to do with student visas and easier access to the UK university system, not so much general immigration, though I may be...