Identifying multiple submissions in Internet research: preserving data integrity
- PMID: 18240015
- PMCID: PMC2615134
- DOI: 10.1007/s10461-007-9352-2
Identifying multiple submissions in Internet research: preserving data integrity
Abstract
Internet-based sexuality research with hidden populations has become increasingly popular. Respondent anonymity may encourage participation and lower social desirability, but associated disinhibition may promote multiple submissions, especially when incentives are offered. The goal of this study was to identify the usefulness of different variables for detecting multiple submissions from repeat responders and to explore incentive effects. The data included 1,900 submissions from a three-session Internet intervention with a pretest and three post-test questionnaires. Participants were men who have sex with men and incentives were offered to rural participants for completing each questionnaire. The final number of submissions included 1,273 "unique", 132 first submissions by "repeat responders" and 495 additional submissions by the "repeat responders" (N = 1,900). Four categories of repeat responders were identified: "infrequent" (2-5 submissions), "persistent" (6-10 submissions), "very persistent" (11-30 submissions), and "hackers" (more than 30 submissions). Internet Provider (IP) addresses, user names, and passwords were the most useful for identifying "infrequent" repeat responders. "Hackers" often varied their IP address and identifying information to prevent easy identification, but investigating the data for small variations in IP, using reverse telephone look up, and patterns across usernames and passwords were helpful. Incentives appeared to play a role in stimulating multiple submissions, especially from the more sophisticated "hackers". Finally, the web is ever evolving and it will be necessary to have good programmers and staff who evolve as fast as "hackers".
Figures
![Fig. 1](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/2615134/bin/nihms85343f1.gif)
Similar articles
-
The good, bad, and ugly of online recruitment of parents for health-related focus groups: lessons learned.J Med Internet Res. 2013 Nov 14;15(11):e250. doi: 10.2196/jmir.2829. J Med Internet Res. 2013. PMID: 24231040 Free PMC article.
-
An updated protocol to detect invalid entries in an online survey of men who have sex with men (MSM): how do valid and invalid submissions compare?AIDS Behav. 2015 Oct;19(10):1928-37. doi: 10.1007/s10461-015-1033-y. AIDS Behav. 2015. PMID: 25805443 Free PMC article.
-
Project SMART: Preliminary Results From a Test of the Efficacy of a Swedish Internet-Based HIV Risk-Reduction Intervention for Men Who Have Sex With Men.Arch Sex Behav. 2016 Aug;45(6):1501-11. doi: 10.1007/s10508-015-0608-z. Epub 2015 Nov 6. Arch Sex Behav. 2016. PMID: 26545912
-
Internet based HIV prevention research targeting rural MSM: feasibility, acceptability, and preliminary efficacy.J Behav Med. 2008 Dec;31(6):463-77. doi: 10.1007/s10865-008-9171-6. Epub 2008 Sep 4. J Behav Med. 2008. PMID: 18770021 Free PMC article. Clinical Trial.
-
Behavioral interventions to reduce risk for sexual transmission of HIV among men who have sex with men.Cochrane Database Syst Rev. 2008 Jul 16;(3):CD001230. doi: 10.1002/14651858.CD001230.pub2. Cochrane Database Syst Rev. 2008. PMID: 18646068 Review.
Cited by
-
Assessing and Improving Data Integrity in Web-Based Surveys: Comparison of Fraud Detection Systems in a COVID-19 Study.JMIR Form Res. 2024 Jan 12;8:e47091. doi: 10.2196/47091. JMIR Form Res. 2024. PMID: 38214962 Free PMC article.
-
Bot or Not? Detecting and Managing Participant Deception When Conducting Digital Research Remotely: Case Study of a Randomized Controlled Trial.J Med Internet Res. 2023 Sep 14;25:e46523. doi: 10.2196/46523. J Med Internet Res. 2023. PMID: 37707943 Free PMC article. Clinical Trial.
-
The detection and management of attempted fraud during an online randomised trial.Trials. 2023 Aug 4;24(1):494. doi: 10.1186/s13063-023-07517-4. Trials. 2023. PMID: 37537678 Free PMC article. Clinical Trial.
-
E-cigarette support for smoking cessation: Identifying the effectiveness of intervention components in an on-line randomized optimization experiment.Addiction. 2023 Nov;118(11):2105-2117. doi: 10.1111/add.16294. Epub 2023 Jul 16. Addiction. 2023. PMID: 37455014 Free PMC article.
-
Web based research in sexual medicine: a position statement of the European Society for Sexual Medicine.Sex Med. 2023 Jul 5;11(3):qfad032. doi: 10.1093/sexmed/qfad032. eCollection 2023 Jun. Sex Med. 2023. PMID: 37426312 Free PMC article. Review.
References
-
- Birnbaum MH. Psychological experiments on the Internet. San Diego: Academic; 2000.
-
- Birnbaum MH. Human research and data collection via the Internet. Annual Review of Psychology. 2004;55:803–832. - PubMed
-
- Bowen AM. Internet sexuality research with rural MSM: Can we recruit and retain them? Journal Sex Research. 2005;42(4):317–323. - PubMed
-
- Catania J. A comment on advancing the frontiers of sexological methods. The Journal of Sex Research. 1999;36:1–2.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources