Measuring what happens to merchants’ public ratings after they go live
A monthly before-and-after report on newly live merchants’ public ratings and review pace. Public review sites only show relative dates like “3 weeks ago”, so the hard part is building an honest baseline.
The method
Only reviews that are certain to fall before go-live count towards the baseline, and merchants without enough history are left out rather than guessed at. The run is a short, documented pipeline: build the cohort, collect the histories, compute the metrics, produce the report.
Decisions
- A collection run that returns nothing is treated as a failure, so a retry never overwrites good history.
- Reviews in every language are kept intact through the whole chain.
- Documented as a runbook, so someone else can run it.
Before and after
| Before | After | |
|---|---|---|
| Producing the report | Manual work over several days | A short, repeatable run |
This describes internal work at qlub. Names, internal rules and business data are left out on purpose. If you want the detail behind any of it, email mikaeel2013@gmail.com and I will walk you through it.