You can only delete the sales tax rate that is not used in goods cards and documents.

To delete a sales tax rate: