When you think about it none of the films or novels state what really happened after most of the immortal races left Middle Earth after the end of the series except that either most or all had gone to somewhere known as the "Twilight Lands" and had (seemingly) never returned and remained only as distant legend.