A big swing away from the state's Labor Party has forced the opposition to hose down speculation it could spark a leadership spill.