According to Amos, "Here. In My Head" was written after Little Earthquakes was "way out". She had planned to include the song on Under the Pink "because I was writing it just when I started writing Pretty Good Year, and should have done that." The song was released as a B-side on "Crucify" in France, Germany, Australia, and the United Kingdom in June 1992.