NotesFAQContact Us
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1189011
Record Type: Journal
Publication Date: 2018
Pages: 12
Abstractor: As Provided
ISSN: ISSN-1364-5579
Mode Effects in Cultural Domain Analysis: Comparing Pile Sort Data Collected via Internet versus Face-to-Face Interviews
Gravlee, Clarence C.; Maxwell, Chad R.; Jacobsohn, Aryeh; Bernard, H. Russell
International Journal of Social Research Methodology, v21 n2 p165-176 2018
This article tests whether collecting pile-sort data online produces results similar to those obtained with face-to-face methods. We collected pile sorts from 227 university students in the cultural domain of emotions. To test for mode and design effects, we randomly assigned participants to face-to-face or internet modes and to either a 15- or 30-item sort. We found no evidence of mode effects in semantic structure, but the level of agreement among respondents varied by mode, depending on the number of items in the task. Agreement was higher among online respondents in the 15-item task but among face-to-face respondents in the 30-item one. Because the central purpose of pile sorting is to elicit semantic structure, we conclude that online data collection is a viable option for most researchers, but the mode effect in level of agreement implies that other design elements may affect comparability of face-to-face and web-based methods.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Grant or Contract Numbers: BCS0244104