You can only delete the VAT rate that is not used in goods cards and documents.
To delete a VAT rate: