Recart Conversion Lab

Real-World Experiments to Accelerate Your List Growth

Postponed Close Button Test (4-Second Delay)

Hypothesis

By delaying the appearance of the close (“X”) button on the popup teaser step by 4-seconds, we believed we could further increase message exposure. Allowing users more time to read and consider the offer before exiting, ultimately improving both email and SMS opt-in rates.

Methodology

An A/B test was conducted across multiple brands’ website popups to evaluate the effect of extending the delay before showing the close button. Two versions were tested:

The Experiment

Site visitors were randomly assigned to one of two experiences:

  • The control group saw the teaser with the close button immediately visible.
  • The variant group experienced a popup where the close button was hidden for the first 4-seconds.

Key performance indicators:

  • Email Conversion Rate – % of visitors who submitted their email
  • SMS Conversion Rate – % of visitors who submitted their phone number

Conversion rates were calculated by dividing opt-ins by total popup impressions.

The Result

The delayed close variant outperformed the control across every tested brand:

Every email and SMS channel saw either a lift or neutral result, with no declines recorded.

Conclusion

Delaying the close button by 4-seconds consistently boosted performance across all brands. The extended pause gave users more uninterrupted time to consider the offer, resulting in higher engagement and conversion rates. The results support the idea that small, intentional friction, when used strategically, can lead to meaningful gains. For brands looking to increase opt-ins without redesigning the entire popup experience, this is a low-effort, high-impact lever worth pulling.