You can only delete the VAT rate that is not used in goods cards and documents.

To delete a VAT rate: