The government's apology follows one from the Church of England last month over its role in the practice.