The Government has agreed that it is right that those who break the law should pay their fair share of the costs to put things right - and not the public purse