Identifying and Preventing Careless Survey Responses

Add to your list(s) Download to your calendar using vCal

• Dr. Adam Meade, North Carolina State University
• Thursday 22 March 2012, 14:00-15:00
• Seminar Room, The Mond Building, New Museums Site.

If you have a question about this talk, please contact Luning Sun.

When data are collected via anonymous Internet surveys, particularly under conditions of obligatory participation (such as with student samples), data quality can be a concern. However, little guidance exists in the published literature regarding techniques for detecting careless responses. I will describe two studies in which several methods for identifying careless responses were examined, including (a) special items designed to detect careless response, (b) response consistency indices formed from responses to typical survey items, (c) multivariate outlier analysis, (d) response time, and (e) self-reported diligence. Results indicated that there are two distinct patterns of careless response (random and non-random) and that different indices are needed to identify these different response patterns. We also found that approximately 10-12% of undergraduates completing a lengthy survey for course credit were identified as careless responders. In Study 2, we simulated data with known random response patterns in order to determine the efficacy of several indicators of careless response. We found that that the nature of the data strongly influenced the efficacy of the indices to identify careless responses. Recommendations will be discussed, including using identified rather than anonymous responses, incorporating instructed response items before data collection, as well as computing consistency indices and multivariate outlier analysis to ensure high quality data.

This talk is part of the Cambridge Psychometrics Centre Seminars series.

This talk is included in these lists:

• Biology
• Cambridge Neuroscience Seminars
• Cambridge Psychometrics Centre Seminars
• Cambridge talks
• Chris Davis' list
• Department of Psychiatry talks stream
• Featured lists
• Life Science
• Life Sciences
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Psychology talks and events
• Seminar Room, The Mond Building, New Museums Site
• Stem Cells & Regenerative Medicine
• Yishu's list
• dh539
• kt532's list

Note that ex-directory lists are not shown.