Product execution mock interview: user engagement (w/ Microsoft PM)

One of the best structure and framework. Ankur did a really great job. I would hire him. One think that I would have considered was dissecting the engagement by source, meaning engagement could come either from 1) users directly opening the app whenever they get the time and 2) engagement coming from PN. This would have helped identifying the root cause faster.

Kenton and Ankur, I tried to think of the plan before I heard Ankur's answer after learning the three changes. My thought process was funnel based check 1) Content Creation: Messenger teams story creation --- Check number of stories uploaded 2) Content Discovery : Notification changes 3)Content recommendation : Story bar.

1:18 STORIES ENGAGEMENT IS DOWN HOW WOULD YOU INVESTIGATE THIS ISSUE? 2:08 2:49 metrics 3:09 the specific metric? 3:50 the specific time period? 5:04 the specific location? 5:50 the specific device/os? 7:11 8:14 9:11 9:43 10:20 10:38 11:30 11:53 13:10 13:30 13:46 experience of using the stories tool that's been changed 14:04 14:40 explanation on the story bar mechanics 15:46 15:58

Something I was expecting to hear about with the experiments 2 & 3 is that if user's time is finite, you're asking them to view stories over a single duration/session versus many smaller ones throughout the day - which they may not want to do, or can't do. Or the stories from the notifications that are batched are competing against each other for the same piece of limited time, resulting in a lower engagement.

Great video and great exercise. Two comments: 1. Facebook doesn't care about NPS/CSAT. 2. I'd also suggest diving deeper into revenue impact given stories are an individual placement for advertisers.

Watch this right before my product sense interview and took alot of inspiration from this! Thanks and keep up the great work

This was amazing. Thanks!

Hats off to Ankur's thorough analysis and breakdown well.

Overall good structuring and explaining the though process or reasons before making any conclusions👍

Idea way for an interview to run. however, it will require the interviewer to be close to the product, and also the question to not be hypothetical for such an exchange to happen. Keeping that aside, a great example of peeling the layers, and letting reasons pave the way through the investigation.

Overall I thought it was excellent framing by Ankur on the interview. The initial framing and approach was perfect. However, I felt a little lost when it came to analyzing the variants in the test. For instance, I would typically approach something like this by identifying all the exhaustive factors - ruling them out one by one to narrow down the specific scenario.With respect to the assumption of no external impact - stock markets are a great example - a lowering of consumer sentiment in US can lead to a ripple effect on all major geos. In this case, it seems like there were underperforming variants in the A/B test. So the approach should have been to first identify the impact to the metrics for the variants and then hypothesize about the change in functionality which could have led to the decline in overall DAUs. Also, it wasnt clear if the A/B test was launched globally or in certain geos or to certain segments ( another hint on whether these were the contributing source ). Overall great stuff.

His upspeak burned a hole in my brain

If the overall engagement was down and the experiment was to bundle notifications, I would investigate that because it’s quite obvious that these notifications would drop driving traffic about stories. Not sure why it got so muddled up in the end.

OK i have watched many of these mock interviews and this is by far the best I have seen. If interviewee really didn't get the question ahead of time, I tip my hat to him on this. Very solid thought process. If it was indeed scripted, still good as it was very illustrative.

An amazing mock interview. The overall framework was great. I really enjoy all your videos. Very insightful.

This is a very good mock, but not Excellent! However, probably this is a realistic interview with minimal behind the scenes preparation. Actually, you want to watch something like this. 1st because it portrays the real reaction of a candidate 2.You learn how to pivot when things does not go perfectly. One good thing in this interview, the candidate pivoted well on potential issues impacting user experience. Some assumptions and comment through the interview, were not necessarily best choices, but again, if this is on the spot interview, i think this really good.

This was very useful! Loved the analysis framework!

Excellent job by Ankur! Thanks for a great video on this topic

Excellent analysis.

Rally detailed and excellent interview though it was hard to keep up with all of the details.