The prime minister's remark came after Commissioner Sir Mark Rowley rejected calls to ban a large pro-Palestinian protest on the poppy day.