Imagine you are a PM at Meta, launching a new video conference product. Define success metrics.

  Meta
Add Your Answer
Answers (3)

Clarifying questions:

  1. Is this tied to any existing Meta ecosystem? WhatsApp or Messenger?
  2. Who is this video conference product targeted at? Consumer or Business?

Assumptions:

  1. It is a consumer product
  2. It is integrated into WhatsApp

Meta’s Mission is to Build community and bring people closer together. A video conference app aligns with that mission by helping groups of people to come together as a community and meet each other

Product mission: A video conference app – that builds community interactions by allowing a group of people to come together and meet via video chat

Product goal: Make it easy for groups to organize video meetings that can be attended by as many participants as desired

There are two User segments:

  1. Organizers
  2. Participants

North Star Success metrics:

Organizers:

Number of meetings per day/month

Participants:

Number of active meeting user-attendees per day/month

Engagement Metrics:

Average duration of meetings

Average Number of attendees per meeting

Number of recurring meetings

Clarifications: – What is this product about? Is it like Zoom or the equivalent of it? Assume to be similar as Zoom – Where is it being launched? Within Faceboook, Insta, WhatsApp or separately? Assume part of Facebook and Insta – Who is using it? All users can use it for free (same as other FB/Insta features, free for all) – Platforms: All platforms as it is not a new platform but more like a feature – What stage? Launched and assumption: Basic video conferencing functionalities to be available: 1:1, 1:N, sharing screen, video or audio only calling etc.

Goals: What are the goals of this? – Assumption: Improve engagement across FB and Insta. Aligning back to where FB or Insta are in product journey. They are mostly aiming for increased engagement – This is not an acquisition feature/tool this is more to improve engagement – Available to all customers/users of FB and Insta

User journey: – Open FB/Insta browse, scrolls, chat with friends, initiate a video call 1:1 – Influencer then share the link for people to join for open forum conversation (1:N) Group Metrics:

  1. Adoption of this feature: How many are unique users using this new feature
  2. Repeatability: How frequently are users using this feature
  3. Stickiness: How frequently are users using this in consecutive weeks ( W,W+1, W+2 etc.)

Video calling experience:

  1. CSAT
  2. Top 3 reasons for liking
  3. Top 3 reasons for not liking
  4. Drop rate, latency vs benchmarks

Utility:

  1. 1:1 vs 1:N video calls made ( In 1:N open vs closed to only friends etc.)
  2. Avg session length
  3. % of calls with usage different features like chat, screen share, background blur etc.

North star: Engagement >> # of unique users using, repeatability, (DAU, WAU, MAU)

Risks:

  1. Content moderation during the 1:N open calls
  2. Difficult to curb to illegal acitvities such as use it for Child abuse, terrorism etc.
  3. Privacy, security issues associated with video calling (recording and storage of data)
  1. Number of calls in a period (say day, weeks, month, etc.)
  2. Average duration of call
  3. Number of call drop offs without the customer disconnecting
  4. MAU, DAU,
  5. New users in a period (say day, weeks, month, etc.)
  6. Churn rate
  7. User rating (post the call, the user rates the call)
  8. App store reviews