He doesn't. The Shiba clan used to be of the great noble households. So Ganju being a warrior from such a noble family it would be an insult to his honor to treat him like just another pest instead of fighting and killing him with his full power.