So this is an issue I've also ran into. The pump is used on multiple vehicles, including some RWD ones (Miata). Due to this, they never come with a dipstick...just a hole. The Miata folks need to plug the hole, and we need to transfer our dipsticks to the new parts.
I never got mine out. I tried to remove it just so I could clean the pump as well as possible, but gave it up as a lost cause. Lot of heat and some vice grips, the damn thing never budged. My next move was to go at it with the 20-ton press, but I didn't want to risk breaking my pump. Since you are removing it from a bad part, that may be your best option. It won't matter if you mess up that pump, as long as you get the tube out. Soak the thing in PB blaster for a while before you try, and give it some heat, too.
There's probably a "correct" way to do it, but hell if I know what it is.