"In Spite of Ourselves" is a country song by John Prine sung as a duet with Iris DeMent. When Key and Peele back out of a performance on Up Late with Miss Piggy, the show needs something to fill the open slot. In the last moment, Kermit the Frog and Miss Piggy sing "In Spite of Ourselves" with Kermit on banjo. Although Kermit insists that it was just an old, corny number, Denise picks up on his chemistry with Piggy and suggests they take a break from their romantic relationship.