You are the PM of Google Hangout . The avg playstore rating is 3 star with 100k reviews but the problem is that 40% of the users gave 5 star rating and 40% gave 1 star. What would you do?
- Marco Silva
Step 1: Understand the problem:
1) What type of apps get 5 star rating vs 1 star rating. Are they from specific company or is the difference in the type of the app?
2) Are these apps targeted towards the same user segment e.g. apps with rating 5 are targetted towards self learning vs. apps with rating 1 were gaming apps targeted at millenials
3) Were all these apps launched during the same time?
4) How are these apps classified based on monetization viz. free vs a cost basis
Step 2: Internal and External issues
Internal issues:
1) Differences in the user experience of the app
2) Paid vs Free App. Higher expectations from a paid app
3) Type of app e.g. targeted at an older user segment gets better rating than a younger user segment
4) Total number of ratings- Apps with higher ratings have lot of reviews and hence averages our bad rating
5) Changes in the quality control policies at Google
External Issues:
1) Lot of similar apps in the market leading to high expectations from the user base
2) Change in education and economic demographics due to which the app features are no longer relevant
3) General perceptions type of app e.g. right sided news, conservative news etc.
4) Availability of investments in the market in apps
Step 3- Hypothesis:
1) Older apps benefit from high number of reviews thereby averaging few bad reviews vs newer apps getting skewed with few number of bad reviews
2) Acceptance policies on app stores have changed with focus only on quality of code vs usability of app
Step 4: Action items
1) Do not compute average score for apps < say 1000 reviews. Just show total review and number of 4+ reviews
2) Update App acceptance policies to consider a usability test done by a certified company. These companies use a crowd similar to the targeted user base of the app and provide feedback.