Thats the danger for leave isn't it. As Brexit Party haven't pulled out completely you're now going to get situations like this which will boost the incumbent, in this case Labour.
Instead of the Convervatives needing to overcome a 7,650 deficit Brexit Party, lets assume thier votes are roughly...