Avoid One Thing was started as a side project by Mighty Mighty Bosstones' bassist Joe Gittleman. The Boston-based group's first album, titled "Avoid One Thing", was released in 2002 on Side One Dummy Records. This album was written and recorded almost solely by Gittleman.