As a person ages, they become unable to hear the most high-pitched sounds anymore. So that would explain the adults not hearing the sound of the bell. As for why the main character hears it even as an adult, let's say his hearing ability is superhuman. * OOO! Good one!