Open the customer and use the “Delete this customer” panel (administrators only) to permanently remove the customer and everything attached to them. See the “How do I delete a customer?” article for exactly what is removed. Because it is irreversible, take a backup first if the record has real history.