To delete a button you would do the following:
Place the cursor below the button.
Click the back button to remove the button
Republish the Email.
note - if you do not have space below or above the button it may not delete (as there is no place for your cursor to go).