If you want to remove a verified address from your account, simply use /verify remove. The associated wallet will not be used for any token roles or other features on any of your link Discord servers any more.
The command takes one parameter:
The Cardano wallet address to remove from the verified address list (starts with addr1).
Keep in mind: It may take a while for the automatic role service to remove the roles that are already assigned to your user.