One is a cave and one is a dungeon entrance, the one under the armos statue. Went into the dungeon and set the side warp to use warp return B. And set the tile warp to enter the dungeon to that also. Seems to have done the trick.
I thought that the warp return point was set soley on what you set in tile warp/side warp. Never realized that the cave had a built in warp return point. Also, being called a warp return I thought that it meant where you come out when returning from where that warp sends you. ie, I go in this door to enter the dungeon so when I come back out I'll go to the warp return point. It's my first quest so I'm still learning. Thanks for your help.