First, I’d like to ask a few clarifying questions.
- Are we focusing on a specific e-commerce site, such as Amazon, or are we thinking about this problem more broadly? -> I assumed that we are thinking about this broadly/generally.
- Have we received any user feedback that might hint at what the problem might be? How did this sales drop come to our attention? -> I assumed that we haven’t yet received user feedback that might indicate what the problem could be and that we detected this drop internally.
So, if I am the Product Manager for an e-commerce site and sales dropped 7% in the last few days, I’d like to examine a few key questions.
First, have we experienced any technical issues that could explain this? For example, are we aware of any downtime, bugs, or other technical issues that could have prevented users from accessing our site or making purchases? If the answer is yes, then we might examine how we can improve the reliability of our site with the SRE or DevOps team. If the answer is no, then we can rule this out.
Second, is this sales drop in line with our forecasts for the year due to seasonality or other factors? I’d want to understand if we’ve seen this trend at this time of year in the past. For example, it might be common for sales to spike around the holiday season and to drop at the beginning of the year and perhaps over the summer. If the answer is yes, we might investigate ways that we can reach users or promote our site during this time of year. That is, assuming that we are looking to improve sales. If the answer is no, then we can rule this out.
Lastly, are there are changes to our product or marketing that could have impacted sales? I’d examine this question starting at the top of the user funnel and work our way down. First, has there been a change that could impact how users discover our site? For example, have we made a change to the way our site appears in search results? Or, have we changed how we advertise on other sites or social media? If the answer is yes, then we might examine how we can adjust our efforts here. If the answer is no, then we can move down the funnel. Next, we might ask this: has traffic to the site decreased? Users can only make purchases if they navigate to our site, so we might see if traffic has decreased. If it has, we might see if there is something preventing them from doing so. Is the link in an ad broken? Or, perhaps there is another reason? If the answer is no, then we can move down the funnel. Our last question might be this: have we introduced a product, feature, or change to our site in the last few days? If the answer is yes, we might examine if that release impacted other key metrics for our business or if this drop is expected. If all “guardrail” metrics indicate that this new product, feature, or change has had a negative impact, we might consider rolling back that change. If this is in line with our expectations, we might closely monitor the situation.