I don't think they'd care.
They'd probably think "well, we won so we're doing the right thing." Doesn't matter if it's a tiny amount - it's a win. In their own heads they'd probably say that it was appealing to the right that won it for them.
And then there is the other option. Enough people are turned off and Tories sneak in as they can rely on their core voters to vote for them whatever. And then we've got fiver more years of their shit, and can you imagine what they'd be like if they were able to remain in power after all the shit of the last few years? They'd feel absolutely bulletproof.
As it stands I can see quite a gain for the LD's and Greens, as Scotland may well be turning away from the SNP given what's going on there and people not being enthused by Starmer and thinking that Labour will win it anyway.