Hi- would like to gather your feedback on this.
Let’s assume hypothetical question: For the core news feed, should we display more video watches or more events?
- Unifying Metric: Would overall active users for newsfeed be the right metric to determine / or should we compare click through rate for video versus event (and calculate each product’s active user uplift)? How to think about relationship/ structure between topline metric vs north star metric in this case? What could be an unifying metric?
How to deal with this type of comparison case where north star metric is different across products? (video : time spend, event: people RSVPed, goal oriented and time spend is less critical)
- Testing for solve: would multi-variant testing be right approach ? (Scenario 1: no change S2: more video watch, S3: more events). How long the test should be run? What are trade-offs for this type of testing?