You should consider refactoring your email marketing strategy when you notice a decline in your open rates or click-through rates. Additionally, if your emails are frequently flagged as spam, or if maintaining your email campaigns becomes overly time-consuming, it's a good sign that refactoring is needed.