Tavárez received no formal education. The son of a construction worker living in poverty, Tavárez shined shoes, sold newspapers and helped out at construction sites. He aspired to be a baseball player but contemplated a career in adult films if he had no future in baseball. He sometimes goes by the nickname "El muñeco" (The Doll).