*Playing the ghostly sword scene or fighting the skeleton minions at the four pillars has no impact on the quest line so you're able to pass by them.

*If you want to do the [[Destroyer of Destiny]] achievement you will of course need to stop at the four pillars.