When someone unsubscribes, you should immediately remove them from your active mailing list. However, it's wise to send a confirmation email indicating that their opt-out request has been processed. This not only confirms the action but also leaves a positive last impression of your brand.