Interview Question

Senior Data Scientist Interview

-Palo Alto, CA

Netflix

How would you build and test a metric to compare two user's ranked lists of movie/tv show preferences?

Answer

Interview Answers

4 Answers

4

1) Develop a list of shows/movies that are representative of different taste categries (more on this later) 2) Obtain ranking of the items in the list from 2 users 3) Use Spearman's rho (or other test that works with rankings) to assess dependence/conguence between the 2 people's rankings. * To find shows/movies to include in the measurement instrument, maybe do cluster analysis on large number of viewer's viewing habits.

Anonymous on

1

Look at the mean average precision of the movies that the users watch out of the rankings. So if out of 10 recommended movies one user prefers the third and the other user prefers the sixth, the recommendation engine of the user who preferred the third would be better. InterviewQuery.com has it more in depth of an answer.

Anonymous on

0

It's essential to demonstrate that you can really go deep... there are plenty of followup questions and (sometimes tangential) angles to explore. There's a lot of Senior Data Scientist experts who've worked at Netflix, who provide this sort of practice through mock interviews. There's a whole list of them curated on Prepfully. prepfully.com/practice-interviews

Anonymous on

3

Probably incorrectly.

Anonymous on

Add Answers or Comments

To comment on this, Sign In or Sign Up.