You’re the product manager for Meta (Facebook) Live. You notice usage is down 20%. How do you go about finding the root cause?
- Dhiraj Mehta
Context
First, let’s just quickly recap what Facebook Live is and how it fits into the Facebook ecosystem. Facebook Live let’s users livestream themselves to users on the Facebook platform similar to Twitch. While there is gaming content on Facebook Live there is also other content like streamers exploring the world around them or showcasing their talents such as music or cooking. Streamers can chat with their viewers. Facebook’s Mission is to bring the world closer together and Facebook Live let’s streamers connect with their followers in a real and meaningful way that is more authentic and interactive than pre-recorded videos.
Strategically speaking this feature is primarily aimed at engagement as a way of retaining Facebooks large existing user base in hopes they don’t defect to other platforms like Twitch, YouTube, or Tiktok which all feature a Live capability.
Clarification
First off, let’s just clarify what exactly the question is saying. “Usage is down” is a fairly ambiguous statement. Usage amongst who, streamers, viewers, or advertisers? We need more clarity in terms of just what metric or set of metrics we are looking at to determine usage is down. For the sake of this problem, let’s just assume viewer usage is down. A few metrics that could indicate Facebook Live usage amongst viewers are as follows:
- Total Number of Minutes Watched – This gives us an absolute measure of how much Live content is being consumed
- Average Number of Minutes Watched per user – This is a good relative metric whereas metric #1 is an absolute metric which will wax and wane with FB usage overall
- Average number of Interactions(comments, likes, subscribes, donations) per stream – Interactions are a deeper form of engagement whereas viewing minutes is more surface level engagement, are they both down?
Honing in on the issue
Now that we know the decrease in usage is amongst viewers, let’s see if we can’t hone in on the issue further by asking a few questions:
- Is this decrease in usage universal across geographies or do certain countries or cities have more or less of a drop in engagement?
- How long has this drop been going on for? Was this a sharp sudden decrease or was a slow gradual decling that is now at 20%?
- Is this endemic to a specific platform like mobile vs desktop? or browser vs app?
- Is there a particular demographic or user segment for whom this decline is more or less apparent? Ex, teens aged 15-18 or live music streams.
Potential Causes
We will need some answers to the above questions to help us properly identify the actual root cause; however, in lieu of that information here are some potential causes:
- Overall Facebook Usage Declines – If there are less Facebook users in general there is going to be less Facebook Live usage as well
- Livestreaming Ban / Censorship – It’s possible a country like China, who has a history of censorship, might become unnerved by the amount of viewership some of these livestreams get and ban them to maintain control. Imagine a foreign Russian speaker streaming the rest of the world’s views on the Ukrainian conflict to Russian citizens.
- Stricter Community Guidelines – Maybe we as an organization decided to impose stricter community guidelines amongst our streamers and whole content categories like Hot Tub Streams are no longer valid.
- Product Cannibalization – Facebook is a very mature product jam packed with a variety of features all competing for users’ attention. It is possible a newly introduced feature like Stories is taking engagement away from other features like Live. Alternatively, other existing features could have just been given more prominent positioning within the UI.
- Competition – Streaming is a competitive space like we mentioned above. A new competitor could of launched or an existing competitor could’ve gained marketshare. For example, a popular streamer like Ninja could’ve previously been using FB Live but then negotiated an exclusive contract with YouTube.
- Bugs – If we notice engagement drops isolated to specific browers or software versions it’s possible something tehnical could be not working right which would negatively impact users and their engagement.
Summary
We clarified just what this drop in usage entails and what metrics we are using to measure usage. Then in an effort to hone in on the root cause we asked several probing questions surrounding the following areas: geography, timeline, platform, and user segmentation. Without answers to the above questions it’s tough to find the root cause but we proposed several potential causes for a drop in engagement.
Side Notes
- I should’ve stated an initial assumption is that our reporting is accurate. So many times have I seen bugs in the reporting or collection of the metrics themselves. Nothing feels worse than finding out the data you’ve been using to guide your decision making is invalid to a certain degree.
- 20% is a pretty large drop so I’m assuming that is statistically signifcant and not part of the natural variance in user behavior or the metrics that monitor them.

Google
Meta