The band released an eponymous EP in 2004 entitled, The Absence, and followed up with their debut album, From Your Grave, in 2005. The band's second album, Riders of the Plague, was released in 2007. The album was praised in a review for finding an "interesting balance" between the genres death metal and thrash metal. In 2007, bassist Micheal Leon joined the band. Drummer Jeramie Kling left the band that same year and was temporarily replaced by drummer Chris Pistillo from the Tampa death metal scene. The band recruited Justin Reynolds as their new drummer in early 2008.