In a development that could become a major setback to Opposition unity ahead of the Delhi elections, the ruling Aam Aadmi Party (AAP) on Thursday threatened to consult other parties within the INDIA alliance about removing the Congress.