Grab a compass from your inventory. When you hold it with your mouse without putting it in your inventory, compass points up, not in the right direction. Fixes when in inventory.