The Diogenes Club was a private establishment that required absolute silence at all times, unless one was in "the Stranger's Room". Mycroft Holmes was one of the founders of the club and spent a lot of his time there, presumably to allow him to think undistracted.