Abstract
This study aims to develop the Cyberostracism Scale (CS) to assess university students’ perceptions of virtual social exclusion. Validity and reliability studies were carried out with 3 different groups (N = 692; %69 women). In the developing process of the scale, EFA, CFA, Item Response Theory (IRT), and criterion-related validity and reliability (Cronbach’s α, McDonald’s ω, and test-retest) analyses were used. EFA results indicated that the CS has a 3-dimensional structure (Direct Excluded, Indirect Excluded, Ignored) which explains 55.74% of the total variance. The CFA results showed that the 3-factor structure of the scale had an acceptable level of fit indices and had a measurement invariance across gender. IRT analysis showed that all items of the scale were coherent and fit with the model. The results indicated that the scale had satisfactory reliability coefficients. The cyberostracism was found to be associated with the ostracism. Results of the study show that the CS is a valid and reliable measurement tool.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abrams, D., Weick, M., Thomas, D., Colbe, H., & Franklin, K. M. (2011). On-line ostracism affects children differently from adolescents and adults. British Journal of Developmental Psychology, 29(1), 110–123. https://doi.org/10.1348/026151010X494089.
Aiken, L., & Groth-Marnat, G. (2006). Psychological testing and assessment. Boston: Allyn and Bacon.
Akın, A., Uysal, R., & Akın, Ü. (2016). Ergenler için ostrasizm (sosyal dışlanma) ölçeğinin Türkçe’ye uyarlanması. Kastamonu Eğitim Dergisi, 24(2), 895–904 https://toad.halileksi.net/sites/default/files/pdf/.
Allen, K. A., Ryan, T., Gray, D. L., McInerney, D. M., & Waters, L. (2014). Social media use and social connectedness in adolescents: the positives and the potential pitfalls. Australian Educational and Developmental Psychologist, 31(1), 18–31. https://doi.org/10.1017/edp.2014.2.
Bahk, C. M., Sheil, A., Rohm, C. E. T., & ve Lin, F. (2010). Digital media dependency, relational orientation and social networking among college students. Communications of the IIMA, 10(3), 69–78 http://iima.org/wp/wp-content/uploads/2017/04/Digital-Media-Dependency-Relational-Orientation-and-Social-Networking_Bahk-etal.pdf.
Baker, F. B. (2001). The basics of item response theory. https://eric.ed.gov/?id=ED458219
Bauman, S., & Pero, H. (2011). Bullying and cyberbullying among deaf students and their hearing peers: an exploratory study. Journal of Deaf Studies and Deaf Education, 16(2), 236–253. https://doi.org/10.1093/deafed/enq043.
Blanchard, A. L., & Markus, M. L. (2004). The experienced “sense” of a virtual community: characteristics and processes. ACM Sigmis Database: The Database for Advances in İnformation Systems, 35(1), 64–79. https://doi.org/10.1145/968464.968470.
Bonetti, L., Campbell, M. A., & Gilmore, L. (2010). The relationship of loneliness and social anxiety with children’s and adolescents’ online communication. Cyberpsychology, Behavior and Social Networking, 13(3), 279–285. https://doi.org/10.1089/cyber.2009.0215.
Buchanan, E. M. (2020). Structural equation modeling. https://doi.org/10.17605/OSF.IO/2Y67F.
Byrne, B. M., & Stewart, S. M. (2006). Teacher’s corner: the MACS approach to testing for multigroup invariance of a second-order structure: a walk through the process. Structural Equation Modeling, 13(2), 287–321. https://doi.org/10.1207/s15328007sem1302_7.
Cain, J., & Chretien, C. (2013). Exploring social media’s potential in interprofessional education. Journal of Research in Interprofessional Practice and Education, 2(3), 1–7. https://doi.org/10.22230/jripe.2013v3n2a110.
Casas, J. A., Del Rey, R., & Ortega-Ruiz, R. (2013). Bullying and cyberbullying: convergent and divergent predictor variables. Computers in Human Behavior, 29(3), 580–587. https://doi.org/10.1016/j.chb.2012.11.015.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5.
Clement, J. (2020). Global social media ranking 2020. https://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/
Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2012). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları (2. Basım). Pegem Akademi.
Davis, K. (2012). Friendship 2.0: Adolescents' experiences of belonging and self-disclosure online. Journal of Adolescence, 35(6), 1527–1536. https://doi.org/10.1016/j.adolescence.2012.02.013.
Demirci, İ. (2019). The adaptation of the Bergen Social Media Addiction Scale to Turkish and the evaluation its relationships with depression and anxiety symptoms. Anatolian Journal of Psychiatry, (SI 1), 15–23. https://doi.org/10.5455/apd.41585.
Eisenberger, N. I., Lieberman, M. D., & Williams, K. D. (2003). Does rejection hurt? An fMRI study of social exclusion. Science, 302(5643), 290–292. https://doi.org/10.1126/science.1089134.
Erdur-Baker, Ö. (2010). Cyberbullying and its correlation to traditional bullying, gender and frequent and risky usage of İnternet-mediated communication tools. New Media ve Society, 12(1), 109–125. 10.1177%2F1461444809341260.
Gilman, R., Carter-Sowell, A., DeWall, C. N., Adams, R. E., & Carboni, I. (2013). Validation of the ostracism experience scale for adolescents. Psychological Assessment, 25(2), 319–330 https://psycnet.apa.org/doi/10.1037/a0030913.
Görzig, A., & Frumkin, L. A. (2013). Cyberbullying experiences on-the-go: when social media can become distressing. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 7(1), Article 4. https://doi.org/10.5817/CP2013-1-4.
Greitemeyer, T., Mügge, D. O., & Bollermann, I. (2014). Having responsive Facebook friends affects the satisfaction ofpsychological needs more than having many Facebook friends. Basic and Applied Social Psychology, 36, 252e258–252e258. https://doi.org/10.1080/01973533.2014.900619.
Hadjipanayis, A., Efstathiou, E., Altorjai, P., Stiris, T., Valiulis, A., Koletzko, B., & Fonseca, H. (2019). Social media and children: what is the paediatrician��s role? European Journal of Pediatrics, 178(10), 1605–1612. https://doi.org/10.1007/s00431-019-03458-w.
Hartgerink, C. H. J., van Beest, I., Wicherts, J. M., & Williams, K. D. (2015). The ordinal effects of ostracism: A meta-analysis of 120 cyberball studies. PLoS ONE, 10(5), e0127002. 10.1371%2Fjournal.pone.0127002.
Hayes, R. A., Wesselmann, E. D., & Carr, C. T. (2018). When nobody “likes” you: perceived ostracism through paralinguistic digital affordances within social media. Social Media + Society, 4(3), 205630511880030. https://doi.org/10.1177/2056305118800309.
Heeren, A., Peschard, V., & Philippot, P. (2012). The causal role of attentional bias for threat cues in social anxiety: a test on a cyber-ostracism task. Cognitive Therapy and Research, 36(5), 512–521. https://doi.org/10.1007/s10608-011-9394-7.
Ho, S. S., Chen, L., & Ng, A. P. (2017). Comparing cyberbullying perpetration on social media between primary and secondary school students. Computers & Education, 109, 74–84. https://doi.org/10.1016/j.compedu.2017.02.004.
Hu, L. T., & Bentler, P. M. (1999). Cut off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Karlen, C. E., & Daniels, J. R. (2011). Cyberostracism and social monitoring: Social anxiety’s effects on reactions to exclusion and inclusion online. Honors Projects, 147. http://digitalcommons.iwu.edu/cgi/viewcontent.cgi?article=1146&context=psych_honproj
Kemp, S. (2020). Digital 2020: Global Overivew Report. Retrieved from https://wearesocial.com/blog/2020/01/digital-2020-3-8-billion-people-use-social-media
Kline, R. B. (2015). Principles and practice of structural equation modeling (4th ed.). Guilford Publications.
Koh, J., & Kim, Y.-G. (2003). Sense of virtual community: a conceptual framework and empirical validation. International Journal of Electronic Commerce, 8(2), 75–94. https://doi.org/10.1080/10864415.2003.11044295.
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x.
Lechner, U., & Hummel, J. (2002). Business models and system architectures of virtual communities: from a sociological phenomenon to peer-to-peer architectures. International Journal of Electronic Commerce, 6(3), 41–53. https://doi.org/10.1080/10864415.2002.11044242.
Lei, Y., Zhang, C., Niu, G., Tong, Y., Tian, Y., & Zhou, Z. (2018). The association between cyber-ostracism and depression: a moderated mediation model. Journal of Psychological Science, 41(1), 98–104. https://doi.org/10.16719/j.cnki.1671-6981.20180115.
Liu, J., Huo, Y., Chen, Y., & Song, P. (2018). Dispositional and experimentally primed attachment security reduced cyber aggression after cyber ostracism. Computers in Human Behavior, 84, 334–341. https://doi.org/10.1016/j.chb.2018.02.040.
Lu, H. Y. (2008). Sensation-seeking, İnternet dependency, and online interpersonal deception. Cyber Psychology ve Behavior, 11(2), 227–231. https://doi.org/10.1089/cpb.2007.0053.
Menesini, E., Nocentini, A., & Camodeca, M. (2013). Morality, values, traditional bullying, and cyberbullying in adolescence. British Journal of Developmental Psychology, 31(1), 1–14. https://doi.org/10.1111/j.2044-835X.2011.02066.x.
Mıhçı, P., & Kılıç Çakmak, E. (2017). Öğrenci siber sağlık ölçekleri geliştirme çalışması. Gazi Eğitim Fakültesi Dergisi, 37(2), 457–491 http://static.dergipark.org.tr/article-download/f4a5/939a/1708/5998229696503.pdf.
Nezlek, J. B., Wesselmann, E. D., Wheeler, L., & Williams, K. D. (2012). Ostracism in everyday life. Group Dynamics: Theory, Research, and Practice, 16(2), 91–104 https://psycnet.apa.org/doi/10.1037/a0028029.
Niu, G.-F., Sun, X.-j., Tian, Y., Fan, C.-Y., & Zhou, Z.-K. (2016). Resilience moderates the relationship between ostracism and depression among Chinese adolescents. Personality and Individual Differences, 99, 77–80. https://doi.org/10.1016/j.paid.2016.04.059.
Niu, G. F., Zhou, Z. K., Sun, X. J., Yu, F., Xie, X. C., Liu, Q. Q., & Lian, S. L. (2018). Cyber-ostracism and its relation to depression among Chinese adolescents: the moderating role of optimism. Personality and Individual Differences, 123, 105–109. https://doi.org/10.1016/j.paid.2017.10.032.
Obar, J. A., & Wildman, S. (2015). Social media definition and the governance challenge: an introduction to the special issue. Telecommunications Policy, 39(9), 745–750 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2663153.
O'Keeffe, G. S., & Clarke-Pearson, K. (2011). The impact of social media on children, adolescents, and families. Pediatrics, 127(4), 800–804. https://doi.org/10.1542/peds.2011-0054.
Peker, A. (2015). Ergenlerin saldirganlik ve siber zorbalik davranişlari arasindaki ilişkilerin incelenmesi. Ekev Akademi Dergisi, 61(61), 323–336 https://d1wqtxts1xzle7.cloudfront.net/49909641/.
Poon, K. T. (2019). Do you reap what you sow? The effect of cyberostracism on moral ımpurity. Basic and Applied Social Psychology, 41(2), 132–146. https://doi.org/10.1080/01973533.2019.1585353.
Poon, K. T., & Chen, Z. (2016). Assuring a sense of growth: a cognitive strategy to weaken the effect of cyber-ostracism on aggression. Computers in Human Behavior, 57, 31–37. https://doi.org/10.1016/j.chb.2015.12.032.
Reich, S., Schneider, F. M., & Heling, L. (2018). Zero likes – Symbolic interactions and need satisfaction online. Computers in Human Behavior, 80, 97–102. https://doi.org/10.1016/j.chb.2017.10.043.
Pullant, J. (2001). SPSS survival manual: a step by step guide to data analysis using SPSS for Windows. Philadelphia, PA Open University Pres.
Schneider, S. K., O'donnell, L., Stueve, A., & Coulter, R. W. (2012). Cyberbullying, school bullying, and psychological distress: a regional census of high school students. American Journal of Public Health, 102(1), 171–177. 10.2105%2FAJPH.2011.300308.
Schneider, F. M., Zwillich, B., Bindl, M. J., Hopp, F. R., Reich, S., & Vorderer, P. (2017). Social media ostracism: the effects of being excluded online. Computers in Human Behavior, 73, 385–393. https://doi.org/10.1016/j.chb.2017.03.052.
Smock, A. D., Ellison, N. B., Lampe, C., & Wohn, D. Y. (2011). Facebook as a toolkit: a uses and gratification approach to unbundling feature use. Computers in Human Behavior, 27, 322e2329–322e2329. https://doi.org/10.1016/j.chb.2011.07.011.
Stark, S., Chernyshenko, O. S., & Drasgow, F. (2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: toward a unified strategy. Journal of Applied Psychology, 91(6), 1292. https://psycnet.apa.org/doi/10.1037/0021-9010.91.6.1292–1306.
Sun, S., Rubin, A. M., & Haridakis, P. M. (2008). The role of motivation and media involvement in explaining İnternet dependency. Journal of Broadcasting ve Electronic Media, 52(3), 408–431. https://doi.org/10.1080/08838150802205595.
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston: Pearson Education.
Tobin, S. J., Vanman, E. J., Verreynne, M., & Saeri, A. K. (2015). Threats to belonging on Facebook: lurking and ostracism. Social Influence, 10(1), 31–42. https://doi.org/10.1080/15534510.2014.893924.
Turkish Statistical Institute (TÜİK) (2019). Türkiye İstatistik Kurumu, Hanehalkı Bilişim Teknolojileri (BT) Kullanım Araştırması, 2019. http://www.tuik.gov.tr/PreHaberBultenleri.do?id=30574
Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740.
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002.
Vorderer, P., & Schneider, F. M. (2017). Social media and ostracism. In K. D. Williams & S. A. Nida (Eds.), Ostracism, exclusion, and rejection (pp. 240–257). New York: Psychology Press https://www.researchgate.net/profile/Frank_Schneider/publication/280305731_Social_media_and_ostracism/links/57f7b92c08ae8da3ce590d9a/Social-media-and-ostracism.pdf.
Williams, K. D. (2007). Ostracism. Annual Review of Psychology, 58, 425–452. https://doi.org/10.1146/annurev.psych.58.110405.085641.
Williams, K. D. (2011). The pain of exclusion. Scientific American Mind, 23(6), 30–38 https://www.jstor.org/stable/10.2307/24943221.
Williams, K. D., Cheung, C. K. T., & Choi, W. (2000). Cyberostracism: effects of being ignored over the İnternet. Journal of Personality and Social Psychology, 79(5), 748–762. https://doi.org/10.1037//0022-3514.79.5.748.
Williams, K. D., & Zadro, L. (2001). Ostracism: On being ignored, excluded and rejected. In M. R. Leary (Ed.), Interpersonal Rejection (pp. 21–53). New York: Oxford University Press.
Williams, K. D., Govan, C. L., Croker, V., Tynan, D., Cruickshank, M., & Lam, A. (2002). Investigations into differences between social- and cyberostracism. Group Dynamics: Theory, Research, and Practice, 6(1), 65–77. https://doi.org/10.1037/1089-2699.6.1.65.
Wolf, W., Levordashka, A., Ruff, J. R., Kraaijeveld, S., Lueckmann, J.-M., & Williams, K. D. (2015). Ostracism Online: a social media ostracism paradigm. Behavior Research Methods, 47(2), 361–373. https://doi.org/10.3758/s13428-014-0475-x.
Wood, M., Bukowski, W., & Lis, E. (2016). The digital self: how social media serves as a setting that shapes youth’s emotional experiences. Adolescent Research Review, 1(2), 163–173. https://doi.org/10.1007/s40894-015-0014-8.
Wu, A. D., Zhen, L., & Zumbo, B. D. (2007). Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assessment, Research, and Evaluation, 12(1), 3. https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1170&context=pare
Yang, L., Ha, L., Wang, F., & Abuljadail, M. (2015). Who pays for online content? A media dependency perspective comparing young and older people. International Journal on Media Management, 17(4), 277–294. https://doi.org/10.1080/14241277.2015.1107567.
Zadro, L., Williams, K. D., & Richardson, R. (2004). How low can you go? Ostracism by a computer is sufficient to lower self-reported levels of belonging, control, self-esteem, and meaningful existence. Journal of Experimental Social Psychology, 40(4), 560–567. https://doi.org/10.1016/j.jesp.2003.11.006.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Informed Consent
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000 (5). Informed consent was obtained from all patients for being included in the study.
Human and Animal Research
Formal approval related to the study was receipt from the Human Research Ethics Committee (No: 2020/57; date: 2020/05/03).
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Hatun, O., Demirci, İ. Developing the Cyberostracism Scale and Examining its Psychometric Characteristics. Int J Ment Health Addiction 20, 1063–1082 (2022). https://doi.org/10.1007/s11469-020-00426-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11469-020-00426-6