I've discovered that one must use the keyboard setting of "linux" in the PuTTY settings in order for the Backspace key to work properly in Vim. The Linux keyboard is not the default. If one does not do this, Vim always is sent the Delete key command when pressing on the Backspace.