Definition
Preventing mistakes and defects in manufactured products and avoiding problems when delivering products or services to customers. – Wikipedia
Also known as QC (Quality Control)
CRO Example
Making sure the experiments you run are not broken, both from a technical and statistical perspective. You should have a thorough checklist of items that you observe and monitor before, during, and after an experiment. Doing things like:
- checking site functionality for all experiment variations across different browsers, devices, and breakpoints (both common and uncommon – use analytics to determine which ones are the most to least important)
- making sure there are no javascript errors
- proofreading
- pre-planning runtime criteria (sample size, duration, MDE, etc.)
- monitoring for sample ratio mismatch
- monitoring for unexpected result data
- monitoring inbound user flow
- having someone else check your work