Remainers plotting to thwart Brexit