If you really want to completely delete a newsletter, click this button:
http://screencast.com/t/XXgsmml7V
Alternatively, if you were to remove a custom newsletter from your sections in the manage tab, it will also stop showing up and nobody will be able to sign up for it. That way you can "reactivate" the newsletter in the future: