Yes, right click and remove should work. No other step for removing.
It should work fine in fact. are you using Metro cluster in your environment? You said, DR site? can you elaborate more on this?
can you give exact steps on how do you configured HA?
As per me, there is some network problem.