All TOBJ objects needs a daytime and a nighttime object at a point to show up at all times. If one object doesn't have the correct timing or is missing entirely, the game will keep using the existing TOBJ object. You will not see a hole in the ground.