The Gerudo Secret Club is only open to those who know the password. Link must find someone who knows the password to gain entry. To get the password, Link must travel across Gerudo Town to The Noble Canteen where he will find three women chatting on the couches. If spoken to directly, they will yell at Link for eavesdropping on their conversation. Spoiler warning: Spoilers end here.