Once a message in a bottle is found and when a player has walked near its spawn location when it was visible it will always be visible, unless the message in the bottle or its treasure map is in the player's bank or inventory. The castaways are marked as found in the Arc Journal after actually interacting with them on their islands.