Before you can use the Treasure Map to get to the treasure location, you will need to fix it. You can't do this manually, so you will need to visit the Jack Marrow NPC instead.