Interview Question

Senior Data Scientist Interview

-Sausalito, CA


How would you test if survey responses were filled at random by certain individuals, as opposed to truthful selections?

AnswerAdd Tags

Interview Answers

4 Answers


This is a very basic psychometrics question. Calculate Cronbach's alpha for the survey items. If it is low (below .5), it is very likely that the questions were answered at random.

Brendan on


I would design the test in a way that certain information is asked two different ways. if two answers disagree with each other I would seriously doubt the validity of the answers.

Anonymous on


We need to find the histograms of the questions in the survey to see the distribution of each answer in each question. All question histograms will likely follow the normal distribution if they are truthful selection. If one response with more than of half of total answers being located outside of 95% confidential interval in each histogram, the response will be categorized as random fall out of mean plus tw

Anonymous on


Similar to Cronbach’s alpha, calculate corrected item-total correlations. Since the item is part of the total, you will need to remove it from each estimate to correct for this. Otherwise, you will get inflated estimates. Drop items with very low item-total correlations (either 1.5. Good luck.

Anonymous on

Add Answers or Comments

To comment on this, Sign In or Sign Up.