40 hours in and I just realized…

You can fast travel directly from the map. That list over on the right? You can select the locations and travel to them LOL