Optimizing the User Funnel via High-Velocity A/B Testing
The Challenge
A leading mental healthcare platform faced a significant performance plateau on one of its most critical acquisition touchpoints: for a “Providers Insurance” page. Despite steady top-of-funnel interest, the page saw a 22.17% monthly drop in form submissions over a six-month period. The existing experience lacked a clear information hierarchy, leading to a steady decline in clinician engagement and an inability to convert high-intent traffic into membership inquiries.
The Strategy
We approached the redesign through the lens of behavioral analytics and technical SEO. Our hypothesis was that by reducing cognitive friction and building clinical authority, we could reverse the downward trend and achieve a target 20% lift in conversions. The existing experience lacked a clear information hierarchy, leading to a steady decline in clinician engagement and an inability to convert high-intent traffic into membership inquiries. The strategy focused on three specific pillars.
01. Semantic Authority & AI Visibility
Restructuring content to favor AI Overviews and LLM citations, ensuring the brand remained the “source of truth” for insurance-related queries.
02. Frictionless UX
Re-engineering the information hierarchy to guide clinicians through the complex insurance program intuitively.
03. CTA Optimization
Testing placements, visual treatments, and persuasive copy to identify the exact tipping point for user intent.
Scope of Work.
- A/B Test: Deploying a controlled experiment to validate the impact of the redesign against a historical baseline.
- Conversion Rate Optimization (CRO): Implementing a Variant design focused on high-intent CTA treatments and educational context.
- User Intent Mapping: Analyzing Click-Through Rates (CTR) to measure the causal impact of the new design on clinical engagement.
- Data-Driven Governance: Utilizing a Minimum Detectable Effect (MDE) framework to ensure practical and statistical significance in a low-traffic environment.
Performance Impact.
From Decline to Double-Digit Lift: The Variant design didn’t just stop the decline; it established a new performance ceiling for the user funnel.
| Metric | Baseline (Pre-Test) | Variant Performance | Improvement |
| Form Submission CVR | 2.04% | 3.72% | +82.35% vs. Baseline |
| Primary CTA CTR | Baseline | +114.36% | >2x Intent Lift |
| In-Test Conversion Lift | 3.29% (Control) | 3.72% (Variant) | +12.99% Lift |
Strategic Outcomes.
- Massive Intent Acceleration: The 114% lift in CTR confirms that the new educational context and CTA treatments successfully resonated with prospective providers, solving the underlying engagement problem.
- Outperforming Historical Norms: The Variant’s 3.72% CVR significantly outperformed the 2.04% historical average, providing a 1.8x increase in overall funnel efficiency.
- Capitalizing on Positive Gains: While the test faced traffic constraints, the consistent +12.99% lift over Control provided the “green light” to deploy, allowing the team to capture immediate growth for H2 goals.
The Growth Engine
While this project delivered an immediate 82% CVR increase over the baseline, the true value lies in the Continuous Optimization Loop.
We treat high-intent pages as living products that require constant refinement to prevent performance decay.
- Compounding Gains: A 12.99% lift serves as a foundational win. Through monthly experimentation and micro-optimizations, we aim to compound these results to potentially double funnel efficiency annually.
- Mitigating Performance Decay: Ongoing testing ensures that as market conditions shift, the site does not slip back into the -4.35% monthly engagement decline observed prior to this project.
- AI & LLM Adaptation: Continuous technical monitoring ensures the page remains “machine-readable” as AI search algorithms evolve, maintaining the brand’s authoritative visibility.
The results are clear: by treating the page as a technical product rather than just a landing page, we didn’t just increase clicks—we solved the intent gap. A 114% CTR lift was a definitive signal that the new design builds the trust clinicians needed.
– Project Lead