An updated protocol to detect invalid entries in an online survey of men who have sex with men (MSM): how do valid and invalid submissions compare?
- PMID: 25805443
- PMCID: PMC5664924
- DOI: 10.1007/s10461-015-1033-y
An updated protocol to detect invalid entries in an online survey of men who have sex with men (MSM): how do valid and invalid submissions compare?
Abstract
Researchers use protocols to screen for suspicious survey submissions in online studies. We evaluated how well a de-duplication and cross-validation process detected invalid entries. Data were from the Sexually Explicit Media Study, an Internet-based HIV prevention survey of men who have sex with men. Using our protocol, 146 (11.6 %) of 1254 entries were identified as invalid. Most indicated changes to the screening questionnaire to gain entry (n = 109, 74.7 %), matched other submissions' payment profiles (n = 56, 41.8 %), or featured an IP address that was recorded previously (n = 43, 29.5 %). We found few demographic or behavioral differences between valid and invalid samples, however. Invalid submissions had lower odds of reporting HIV testing in the past year (OR 0.63), and higher odds of requesting no payment compared to check payments (OR 2.75). Thus, rates of HIV testing would have been underestimated if invalid submissions had not been removed, and payment may not be the only incentive for invalid participation.
Keywords: Bias; HIV; Questionnaires; Survey methods; Validity.
Similar articles
-
Fraud Detection Protocol for Web-Based Research Among Men Who Have Sex With Men: Development and Descriptive Evaluation.JMIR Public Health Surveill. 2019 Feb 4;5(1):e12344. doi: 10.2196/12344. JMIR Public Health Surveill. 2019. PMID: 30714944 Free PMC article.
-
Internet-based partner selection and risk for unprotected anal intercourse in sexual encounters among men who have sex with men: a meta-analysis of observational studies.Sex Transm Infect. 2014 Jun;90(4):290-6. doi: 10.1136/sextrans-2013-051332. Epub 2014 Feb 11. Sex Transm Infect. 2014. PMID: 24518249 Review.
-
Internet-based recruitment system for HIV and STI screening for men who have sex with men in Estonia, 2013: analysis of preliminary outcomes.Euro Surveill. 2015 Apr 16;20(15):21094. Euro Surveill. 2015. PMID: 25953131
-
iTunes song-gifting is a low-cost, efficient recruitment tool to engage high-risk MSM in internet research.AIDS Behav. 2015 Oct;19(10):1914-8. doi: 10.1007/s10461-015-1130-y. AIDS Behav. 2015. PMID: 26174208
-
Life in the Sick-Room. Essays by an Invalid.Br Foreign Med Rev. 1844 Oct;18(36):472-481. Br Foreign Med Rev. 1844. PMID: 30162235 Free PMC article. Review. No abstract available.
Cited by
-
Discrimination of Sexual and Gender Minority Patients in Prostate Cancer Treatment: Results from the Restore-1 Study.Stigma Health. 2023 Feb;8(1):85-92. doi: 10.1037/sah0000356. Epub 2022 Jan 20. Stigma Health. 2023. PMID: 36779009 Free PMC article.
-
Nominal Versus Realized Costs of Recruiting and Retaining a National Sample of Sexual Minority Adolescents in the United States: Longitudinal Study.J Med Internet Res. 2023 Feb 2;25:e36764. doi: 10.2196/36764. J Med Internet Res. 2023. PMID: 36729597 Free PMC article.
-
Bots and nots: Safeguarding online survey research with underrepresented and diverse populations.Psychol Sex. 2022;13(4):901-911. doi: 10.1080/19419899.2021.1936617. Epub 2021 Jun 7. Psychol Sex. 2022. PMID: 36439051 Free PMC article.
-
Experiences of violence and discrimination among LGBTQ+ individuals during the COVID-19 pandemic: a global cross-sectional analysis.BMJ Glob Health. 2022 Sep;7(9):e009400. doi: 10.1136/bmjgh-2022-009400. BMJ Glob Health. 2022. PMID: 36130772 Free PMC article.
-
Perspectives on Cigarette Use, Vaping, and Antitobacco Campaigns Among Adolescent Sexual Minority Males and Gender Diverse Youth.LGBT Health. 2022 Oct;9(7):479-488. doi: 10.1089/lgbt.2021.0460. Epub 2022 Jul 7. LGBT Health. 2022. PMID: 35796707 Free PMC article.
References
-
- van Gelder MMHJ, Bretveld RW, Roeleveld N. Web-based questionnaires: the future in epidemiology? Am J Epidemiol. 2010;172(11):1292. - PubMed
-
- Bowen A. Internet sexuality research with rural men who have sex with men: can we recruit and retain them? J Sex Res. 2005;42(4):317–23. - PubMed
-
- Rosser BRS, Konstan J, Gurak L, et al. Recruiting high risk Latino MSM for Internet prevention research. STD/HIV Prevention and the Internet Conference; Washington. 2001.
-
- Salyers Bull S, Lloyd L, Rietmeijer C, McFarlane M. Recruitment and retention of an online sample for an HIV prevention intervention targeting men who have sex with men: The Smart Sex Quest Project. AIDS Care. 2004;16(8):931–43. - PubMed
-
- Bockting WO, Miner MH, Robinson BE, et al. Use of the Internet to reach the US transgender population for HIV/STD prevention research. STD/HIV Prevention and the Internet Conference; Washington. 2003.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
Miscellaneous