In a press event in July of 2011, a picture was taken by the attendees from Diablo3.cc, which shows the waypoint menu, viewed below.

Indeed, the waypoints show up only when the player has been to the waypoint, and there also appears to be an option to spawn at the last checkpoint that the player has visited.