In order to mark a company for deletion you will need open the company record, in the header tab you will need to un-mark all 3 check boxes on the right hand side for Prospect, Customer and Supplier.

Save your changes.

This company will now not show when searched for, but no history against this customer will be deleted.