You cannot delete a correspondent if it is used in documents.

To delete a correspondent: