Reverse trial in-app A/B — proposal v2 (revision)

Iterated based on your feedback. CTA white border restored. Msg 1 is now a holdout. Msgs 3/4/6 are CTA-only tests on the offer banner. Msg 2 uses the winning Sales Outreach voice. Msgs 7 and 8 rewritten. Mockup-only — nothing has been written to CIO yet.

Workspace 199348 · Campaign 50 · 2026-05-21 · revision 2
What changed since the last review:
Msg 1 Day 0 Modal takeover
Holdout (no message)
Hypothesis

Showing no day-0 modal at all outperforms the welcome modal — testing whether msg 1 has any value for users on signup.

Rationale

50/50 split: 50% of users see the control welcome modal, 50% see nothing on signup. We measure downstream paid conversion per arm. If the no-message arm matches or beats control, msg 1 can be retired.

Tracked
CONTROLtpl 279 · In-app 1 DARK - Modal Takeover (Trial Start)
HOLDOUT (NO MESSAGE)Holdout (no message)
No message shown
Variant cohort sees nothing on signup
Msg 2 Day 1 Bottom-right pop-up
Glen — no-pressure voice
Hypothesis

Applying the winning Sales Outreach voice (no-pressure, honest, "stuck on anything") to the Glen pop-up lifts bookings vs the control's discovery-call framing.

Rationale

Mirrors the winning Sales Outreach email tone (tpl 342): "Stuck on anything? Or want a hand getting set up? Happy to help — no pressure." Same Calendly destination.

TrackedRT-msg-2-v2-help-framing
CONTROLtpl 281 · In-app 2 - Glen Intro (Pop-up)
PROPOSED VARIANTGlen — no-pressure voice
Msg 3 Day 2 Top banner
CTA test: Claim offer
Hypothesis

Replacing 'Upgrade' with 'Claim offer' on the day-2 discount banner lifts CTR because 'claim' reframes the action from commercial commitment to capturing a benefit.

Rationale

Same body copy as control ("Get 50% off for your first 6 months"). Only the CTA verb changes — minimal test surface, clean single-variable comparison.

TrackedRT-msg-3-v2-claim-offer
CONTROLtpl 282 · Banner - 50% off 6 months
PROPOSED VARIANTCTA test: Claim offer
Msg 4 Day 3 Top banner (no-reminders branch)
CTA test: Claim offer
Hypothesis

Same 'Upgrade' → 'Claim offer' CTA test at day 3 (no-reminders branch). Tests whether the lift holds across trial days + targeting branches.

Rationale

Identical to msg 3 — control body kept, only CTA changes. Replicating the test across day-3 no-reminders branch builds confidence in any observed lift.

TrackedRT-msg-4-v2-claim-offer
CONTROLtpl 283 · Banner - 50% off 6 months
PROPOSED VARIANTCTA test: Claim offer
Msg 5 Day 3 Bottom-right pop-up (viewed-reminders branch)
Close the loop
Hypothesis

Treating a partially-completed task as "one step to finish" outperforms re-explaining the value because the user has already shown intent by viewing the page.

Rationale

Branch fires only if reminders_page_viewed == true. Control explains what reminders are — but the user is past that point. Variant skips the explanation, asks for the last step.

TrackedRT-msg-5-v2-finish-setup
CONTROLtpl 280 · In-app 3 - First win (Pop Up)
PROPOSED VARIANTClose the loop
Msg 6 Day 4 Top banner
CTA test: Claim offer
Hypothesis

Third replication of the 'Upgrade' → 'Claim offer' CTA test, at day 4. Triple-replicated test across days 2, 3, 4 = ~3× sample size on the same hypothesis.

Rationale

Identical structure to msg 3 + 4. Control body kept, CTA flipped. Three placements of the same test give stronger statistical power on the CTA lever.

TrackedRT-msg-6-v2-claim-offer
CONTROLtpl 285 · Banner - 50% off 6 months
PROPOSED VARIANTCTA test: Claim offer
Msg 7 Day 7 Modal takeover
Halfway, no loss list
Hypothesis

Reframing day 7 from "what you'll lose" to "what's earned its place" outperforms because the email sequence already handles loss messaging — variant adds a positive in-app counterweight.

Rationale

Day 7. Headline drops the "Day 7 of 14" formality for "Halfway there". Body asks which features have earned a place — same 4-item list as control, but framed positively. CTA stays "Keep Advanced".

TrackedRT-msg-7-v2-halfway-reflection
CONTROLtpl 284 · In-app - 7 Days Left (Modal Takeover)
PROPOSED VARIANTHalfway, no loss list
Msg 8 Day 11 Modal takeover (Stripe-disabled branch)
Stronger payments benefit
Hypothesis

Replacing the control's vague "one of the big unlocks" intro with a concrete outcome (cards charged in-session, settle in 2 days, no chasing) lifts bookings because clinicians convert on specific benefits not category labels.

Rationale

Eyebrow ($1,000 FREE) + h2 (15 min) + p2 ($1k hook) + CTA stay identical to control. Only p1 changes — from vague "big unlocks" to specific cash-flow benefit. Single-variable test.

TrackedRT-msg-8-v2-stronger-benefit
CONTROLtpl 317 · In-app 1 DARK - Modal Takeover (Trial Start)
PROPOSED VARIANTStronger payments benefit
Msg 9 Day 12 Bottom-right pop-up
Calm 2-day timeline
Hypothesis

Stating time-remaining without loss-listing outperforms because the email sequence already covered the loss; variant adds a calmer in-app counterweight.

Rationale

Day 12. Loss emails fully landed. "You'll miss out on…" reads heavy by now. Variant just states the timeline + a calm reassurance: workspace stays as-is when you keep Advanced.

TrackedRT-msg-9-v2-calm-timeline
CONTROLtpl 286 · In-app 2 - 2 Days left (Pop Up)
PROPOSED VARIANTCalm 2-day timeline
Msg 10 Day 13 Top banner
Tomorrow frame
Hypothesis

A simple time-statement banner ("ends tomorrow") outperforms a discount banner because clinicians prefer a date over a deal at end-of-trial.

Rationale

Day 13. Email "ends tomorrow" lands today/tomorrow. Variant in-app matches the email's calm date-framing — drops the price overlay, matches the email's reality.

TrackedRT-msg-10-v2-tomorrow-frame
CONTROLtpl 288 · Banner - 50% off 6 months
PROPOSED VARIANTTomorrow frame
Msg 11 Day 14 Modal takeover
Today frame, no snooze
Hypothesis

Removing the "remind me tomorrow" snooze + calmer factual framing outperforms because the snooze contradicts the day-14 deadline and the loss-list theatre fatigues by now.

Rationale

Day 14 — trial actually ends today. Control's "remind me tomorrow" CTA is operationally false (tomorrow = Free). Variant removes the snooze; single calm decision.

TrackedRT-msg-11-v2-today-frame
CONTROLtpl 287 · In-app - Final Day (Modal Takeover)
PROPOSED VARIANTToday frame, no snooze