If they had done anything untoward wouldn't they have slipped quietly away by now thinking "job done"
Personally I feel it is overwhelming guilt that drives them on. Shows the class divide in that she is held in such high regard whereas a single lower class Mum would have been crucified.