If you enter outside the house without anyone waiting, you could just get to anywhere in time. Even to the time, when the house didn't exist.