If he manages to steal from everyone, he will disappear and the weapons will be lost, but if he is killed you get your weapons back. The Pentagon Thief has an abnormally large amount of health however, and is very fast, so killing him is not necessarily easy. It is implied that he is somehow connected to the Illuminati and has travelled through time.