Scale of problematic internet use in university students: evidence of validity and reliability
DOI:
https://doi.org/10.22235/cp.v12i2.1686Keywords:
Internet dependence, social networks, university students, psychological tests, psychological assessmentAbstract
The objective of these two studies was to gather evidence of the validity and precision of the Scale of Problematic Internet Use. In Study 01, 240 university students, with an average age of 22.96 years (SD = 3.45), answered scale and sociodemographic questions. The results of an exploratory factor analysis indicated a one-dimensional structure, explaining 49.01% of the total variance and comprising eight items, with a Cronbach’s alpha of .84. In Study 02, 235 university students, with an average age of 23.95 years (SD = 6.67), responded to the same instruments. Using confirmatory factor analysis, the structure can be confirmed and presents excellent fit indicators: CFI = .99, TLI = .99, RMSEA = .03 (90% CI = .00-.07) and Pclose = .72, in addition to a Cronbach’s alpha of .82. It was concluded that the instrument presents evidence of validity and precision and can be used to gauge the problematic use of the Internet and investigate its relationships to the study population.
Downloads
Download data is not yet available.
References
Abreu, C. N., & Góes, D. N. (2011). Dependência de internet. In B. Rangé (Orgs.), Psicoterapias cognitivo-comportamentais (pp. 440-458). Porto Alegre: Artmed.
Abreu, C. N.; Eisenstein, E.; & Esteffenon, S. G. (2013). Vivendo esse mundo digital: impactos na saúde, na educação e nos comportamentos sociais. Porto Alegre: Artes Médicas.
Asún, R. A., Rdz-Navarro, K., & Alvarado, J. M. (2015). Developing multidimensional likert scales using item factor analysis: The case of four-point items. Sociological Methods & Research, 45(1), 109-133. doi:10.1177/0049124114566716
Byrne, B. M. (2010). Structural equation modeling with Amos: Basic concepts, applications, and programmimg (2ed.). New York, NY: Routledge.
Caplan, S.E. (2002). Problematic Internet use and psychosocial well-being: Development of a theory-based cognitive-behavioral measurement instrument. Computers in Human Behavior, 18(5), 553-575. doi: 10.1016/S0747-5632(02)00004-3
Castells, M. (2013). Redes de indignação e esperança: movimentos na era da internet. Rio de Janeiro: Zahar.
Ceyhan, A. A; Ceyhan, E. (2008). Loneliness, Depression, and Computer Self-Efficacy as Predictors of Problematic Internet Use. Cyberpsychology & Behavior, 11(6), 699-701. doi: 10.1089/cpb.2007.0255
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309-319. Recuperado de http://www.personal.kent.edu/~dfresco/CRM_Readings/Clark_and_Watson_1995.pdf
Clark, D. J., & Frith, K. H. (2005). The development and initial testing of the Internet Consequences Scales (ICONS). Comput Inform Nurs, 23(5), 285-291. doi: 10.1097/00024665-200509000-00013
Cohen, R. J., Swerdlik, M. E., & Sturman, E. D. (2014). Testagem e Avaliação Psicológica: Introdução a Testes e Medidas. (8º ed) São Paulo: AMGH.
Conti, M. A., Jardim, A. P., Hearst, N., Cordás, T. A., Tavares, H., & Abreu, C. N. (2012). Avaliação da equivalência semântica e consistência interna de uma versão em português do Internet Addiction Test (IAT). Revista de Psiquiatria Clínica, 39(3), 106-110. doi: 10.1590/S0101-60832012000300007
Cozby, P. C. (2003). Métodos de pesquisa em ciências do comportamento. São Paulo: Atlas.
Davis, R. A., Flett, G. L., & Besser, A. (2002). Validation of a new scale for measuring problematic internetuse: implications for pre-employment screening. Cyberpsychol Behav, 5(4), 331-345. doi: 10.1089/109493102760275581
Gámez-Guadix, M., Villa-George, F. I., & Calvete, E. (2012). Measurement and analysis of the cognitive-behavioral modelo f generalized problematic internet use among Mexican adolescentes. J Adolesc, 35(6), 1581-91. doi: 10.1016/j.adolescence.2012.06.005
Gálvez-Nieto, J. L., Vera-Bachman, D., Cerda, C., & Díaz, R. (2016). Escala de Victimización entre Adolescents através del Teléfono Móvil y de Internet: Estudio de Validación de uma Versión Abreviada em Estudiantes Chilenos. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica. 41(1), 145-158.
Holgado-Tello, F. P., Chacón-Moscoso, S., Barbero-García, I., & Vila-Abad, E. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality & Quantity, 44(1), 153-166. doi:10.1007/s11135-008-9190-y
Hong, S. B., Zalesky, A., Cocchi, L., Fornito, A., Choi, E. J., Kim, H. H., ... , Yim, S. (2013). Decreased functional brain connectivity in adolescents with internet addiction. PLoS One, 8(2). doi: 10.1371/jornal.pone.0057831.
Huang, Z., Wang, M., Qian, M., Zhong, J., & Tao, R. (2007). Chinese Internet addiction inventory: developing a measure of problematic Internet use for Chinese college students. Cyberpsychol Behav, 10(6), 805-811. doi: 10.1089/cpb.2007.9950
Kirschner, P. A, & Karpinski, A. C. (2010). Facebook and academic performance. Computers in Human Behavior, 26, 1237–1245. doi: 10.1016/j.chb.2010.03.024
Kuss, D. J., & Griffiths, M. D. (2011). Online social networking and addiction – A review of the psychological literature. International Journal of Environmental Research and Public Health, 8(9), 3528-3552. doi: 10.3390/ijerph8093528
Laconi, S., Rodgers, R. F., & Chabrol, H. (2014). The measurement of Internet addiction: A critical review of existing scales and their psychometrics properties. Comput Human Behav, 41, 190-202. doi: 10.1016/j.chb.2014.09026
Lam, L. T. (2014). Internet gaming addiction, problematic use of the Internet, and sleep problems: A systematic review. Current Psychiatry Reports, 16(4), 444. doi: 10.1007/s11920-014-0444-1
Lara, S. A. D. (2014). ¿Matrices Policóricas/Tetracóricas o Matrices Pearson? Un estudio metodológico. Revista Argentina de Ciencias del Comportamiento, 6(1), 39-48. Recuperado de http://www.redalyc.org/articulo.oa?id=333430869006
Lima, N. L., Moreira, J. O., Stengel, M., & Maia, L. M. (2016). As redes sociais virtuais e a dinâmica da internet. Gerais: Revista Intersinstitucional de Psicologia, 9(1), 90-109. Recuperado de http://pepsic.bvsalud.org/scielo.php?script=sci_abstract&pid=S1983-82202016000100008
Lorenzo-Seva, U., & Ferrando, P. J. (2013). FACTOR 9.2: A Comprehensive Program for Fitting Exploratory and Semiconfirmatory Factor Analysis and IRT Models. Applied Psychological Measurement, 37(6), 497-498. doi:10.1177/0146621613487794
Lorenzo-Seva, U., Timmerman, M. E., & Kiers, H. A. L. (2011). The Hull Method for Selecting the Number of Common Factors. Multivariate Behavioral Research, 46(2), 340-364. doi:10.1080/00273171.2011.564527
Marques, T. P., Pinto, A. M., & Alvarez, M. J. (2016). Estudo Psicométrico da Escala de Avaliação dos Riscos e Oportunidades dos Jovens Utilizadores do Facebook. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica. 41(1). 145-158. Recuperado de http://www.aidep.org/sites/default/files/articles/R41/Art12.pdf
Markus, K. A., & Borsboom, D. (2013). Frontiers of test validity theory: Measurement, causation, and meaning (Multivariate Applications Series). New York: Routledge.
Muthén, L. K., & Muthén, B. O. (2014). Mplus user’s guide. (Seventh Ed.). Los Angeles: Muthén & Muthén.
Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill Inc
Oliveira, F., & Pasqualini, K. C. (2014). Os dependentes de internet no Brasil: realidade ou mito entre os universitários. Mimesis Bauru, 35(1), 95-140. Recuperado de http://docplayer.com.br/3356503-Os-dependentes-de-internet-no-brasil-realidade-ou-mito-entre-os-universitarios.html
Pasquali, L. (2010). Instrumentação psicológica: Fundamentos e práticas. Porto Alegre, RS: Artmed.
Pezoa-Jares, R. E., Espinola-Luna, I. L., & Vasquez-Medina, J. A. (2012). Internet Addiction: A Review. J Addict Res Ther, 56, 1-10. doi: 10.4172/2155-6105.S6-004
Picon, F., Karam, R., Breda, V., Restano, A., Silveira, A., & Spritzer, D. (2015). Precisamos falar sobre tecnologia: caracterizando clinicamente os subtipos de dependência de tecnologia. Revista brasileira de psicoterapia, 17(2), 44-60. Recuperado de http://rbp.celg.org.br/detalhe_artigo.asp?id=177
Pontes, H. M., Patrão, I. M., & Griffiths, M. D. (2014). Portuguese validation of the Internet Addiction Test: Na empirical study. J Behav Addict, 3(2), 107-114. doi: 10.1556/JBA.3.2014.2.4
Rossel, Y. (2012). Lavaan: na R package for structural equation modeling. Jounal of Statistical Sofware, 48(2), 1-36. doi: 10.18637/jss.v048.i02
Salgado, P. G., Boubeta, A. R., Tobío, T. B., Malou, J. V., & Couto, C. B. (2014). Evaluation and early detection of problematic Internet use in adolescentes. Psicothema, 26(1), 21-26. doi: 10.7334/psicothema2013.109
Sasmaz, T., Oner, S., Kurt, A. O., Yapici, G., Yazici, A. E., Buqdayci, R., & Sis, M. (2014). Prevalence and risk factors of Internet addiction in high school students. European Journal of Public Health, 24(1), 15-20. doi:10.1093 / eurpub / ckt051
Secretaria de Comunicação Social da Presidência da República (2015). Pesquisa
Brasileira de Mídia 2015. Hábitos de consumo de Mídia pela população brasileira. Recuperado de: http://www.secom.gov.br/atuacao/pesquisa/lista-de-pesquisas-quantitativas-e-qualitativas-de-contratos-atuais/pesquisa-brasileira-de-midia-pbm-2015.pdf
Silva, H. R., Areco, K. C., Bandiera-Paiva, P., Galvão, P. V., Garcia, A, N., & Silveira, D. X. (2014). Avaliação da equivalência semântica da versão em português (Brasil) da Online Cognition Scale. Caderno Saude Publica, 30(6), 1327-34. doi: 10.1590/0102-311X00153413
Sousa, V., & Rojjanasrirat, W. (2010). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268-274. doi: 10.1111/j.1365-2753.2010.01434.x
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6ªed.). Nova Iorque: Allyn & Bacon.
Tsitsika, A., Critselis, E., Janikian, M., Kormas, G., & Kafetzis, D. A. (2011). Association Between Internet Gambling and Problematic Internet Use Among Adolescents. Journal of Gambling Studies, 27, 389–400. doi: 10.1007/s10899-010-9223-z
Wallace, P. (2014). Internet addiction disorder and youth: There are growing concerns about compulsive online activity and that this could impede students’ performance and social Ilves. EMBO Rep, 15(1), 12-6. doi: 10.1002/embr.201338222
Widyanto, L., & McMurran, M. (2004). The psychometic properties of the internet addiction test. Cyberpsychology Behav, 7(4), 443-450. doi: 10.1089/cpb.2004.7.443
Abreu, C. N.; Eisenstein, E.; & Esteffenon, S. G. (2013). Vivendo esse mundo digital: impactos na saúde, na educação e nos comportamentos sociais. Porto Alegre: Artes Médicas.
Asún, R. A., Rdz-Navarro, K., & Alvarado, J. M. (2015). Developing multidimensional likert scales using item factor analysis: The case of four-point items. Sociological Methods & Research, 45(1), 109-133. doi:10.1177/0049124114566716
Byrne, B. M. (2010). Structural equation modeling with Amos: Basic concepts, applications, and programmimg (2ed.). New York, NY: Routledge.
Caplan, S.E. (2002). Problematic Internet use and psychosocial well-being: Development of a theory-based cognitive-behavioral measurement instrument. Computers in Human Behavior, 18(5), 553-575. doi: 10.1016/S0747-5632(02)00004-3
Castells, M. (2013). Redes de indignação e esperança: movimentos na era da internet. Rio de Janeiro: Zahar.
Ceyhan, A. A; Ceyhan, E. (2008). Loneliness, Depression, and Computer Self-Efficacy as Predictors of Problematic Internet Use. Cyberpsychology & Behavior, 11(6), 699-701. doi: 10.1089/cpb.2007.0255
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309-319. Recuperado de http://www.personal.kent.edu/~dfresco/CRM_Readings/Clark_and_Watson_1995.pdf
Clark, D. J., & Frith, K. H. (2005). The development and initial testing of the Internet Consequences Scales (ICONS). Comput Inform Nurs, 23(5), 285-291. doi: 10.1097/00024665-200509000-00013
Cohen, R. J., Swerdlik, M. E., & Sturman, E. D. (2014). Testagem e Avaliação Psicológica: Introdução a Testes e Medidas. (8º ed) São Paulo: AMGH.
Conti, M. A., Jardim, A. P., Hearst, N., Cordás, T. A., Tavares, H., & Abreu, C. N. (2012). Avaliação da equivalência semântica e consistência interna de uma versão em português do Internet Addiction Test (IAT). Revista de Psiquiatria Clínica, 39(3), 106-110. doi: 10.1590/S0101-60832012000300007
Cozby, P. C. (2003). Métodos de pesquisa em ciências do comportamento. São Paulo: Atlas.
Davis, R. A., Flett, G. L., & Besser, A. (2002). Validation of a new scale for measuring problematic internetuse: implications for pre-employment screening. Cyberpsychol Behav, 5(4), 331-345. doi: 10.1089/109493102760275581
Gámez-Guadix, M., Villa-George, F. I., & Calvete, E. (2012). Measurement and analysis of the cognitive-behavioral modelo f generalized problematic internet use among Mexican adolescentes. J Adolesc, 35(6), 1581-91. doi: 10.1016/j.adolescence.2012.06.005
Gálvez-Nieto, J. L., Vera-Bachman, D., Cerda, C., & Díaz, R. (2016). Escala de Victimización entre Adolescents através del Teléfono Móvil y de Internet: Estudio de Validación de uma Versión Abreviada em Estudiantes Chilenos. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica. 41(1), 145-158.
Holgado-Tello, F. P., Chacón-Moscoso, S., Barbero-García, I., & Vila-Abad, E. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality & Quantity, 44(1), 153-166. doi:10.1007/s11135-008-9190-y
Hong, S. B., Zalesky, A., Cocchi, L., Fornito, A., Choi, E. J., Kim, H. H., ... , Yim, S. (2013). Decreased functional brain connectivity in adolescents with internet addiction. PLoS One, 8(2). doi: 10.1371/jornal.pone.0057831.
Huang, Z., Wang, M., Qian, M., Zhong, J., & Tao, R. (2007). Chinese Internet addiction inventory: developing a measure of problematic Internet use for Chinese college students. Cyberpsychol Behav, 10(6), 805-811. doi: 10.1089/cpb.2007.9950
Kirschner, P. A, & Karpinski, A. C. (2010). Facebook and academic performance. Computers in Human Behavior, 26, 1237–1245. doi: 10.1016/j.chb.2010.03.024
Kuss, D. J., & Griffiths, M. D. (2011). Online social networking and addiction – A review of the psychological literature. International Journal of Environmental Research and Public Health, 8(9), 3528-3552. doi: 10.3390/ijerph8093528
Laconi, S., Rodgers, R. F., & Chabrol, H. (2014). The measurement of Internet addiction: A critical review of existing scales and their psychometrics properties. Comput Human Behav, 41, 190-202. doi: 10.1016/j.chb.2014.09026
Lam, L. T. (2014). Internet gaming addiction, problematic use of the Internet, and sleep problems: A systematic review. Current Psychiatry Reports, 16(4), 444. doi: 10.1007/s11920-014-0444-1
Lara, S. A. D. (2014). ¿Matrices Policóricas/Tetracóricas o Matrices Pearson? Un estudio metodológico. Revista Argentina de Ciencias del Comportamiento, 6(1), 39-48. Recuperado de http://www.redalyc.org/articulo.oa?id=333430869006
Lima, N. L., Moreira, J. O., Stengel, M., & Maia, L. M. (2016). As redes sociais virtuais e a dinâmica da internet. Gerais: Revista Intersinstitucional de Psicologia, 9(1), 90-109. Recuperado de http://pepsic.bvsalud.org/scielo.php?script=sci_abstract&pid=S1983-82202016000100008
Lorenzo-Seva, U., & Ferrando, P. J. (2013). FACTOR 9.2: A Comprehensive Program for Fitting Exploratory and Semiconfirmatory Factor Analysis and IRT Models. Applied Psychological Measurement, 37(6), 497-498. doi:10.1177/0146621613487794
Lorenzo-Seva, U., Timmerman, M. E., & Kiers, H. A. L. (2011). The Hull Method for Selecting the Number of Common Factors. Multivariate Behavioral Research, 46(2), 340-364. doi:10.1080/00273171.2011.564527
Marques, T. P., Pinto, A. M., & Alvarez, M. J. (2016). Estudo Psicométrico da Escala de Avaliação dos Riscos e Oportunidades dos Jovens Utilizadores do Facebook. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica. 41(1). 145-158. Recuperado de http://www.aidep.org/sites/default/files/articles/R41/Art12.pdf
Markus, K. A., & Borsboom, D. (2013). Frontiers of test validity theory: Measurement, causation, and meaning (Multivariate Applications Series). New York: Routledge.
Muthén, L. K., & Muthén, B. O. (2014). Mplus user’s guide. (Seventh Ed.). Los Angeles: Muthén & Muthén.
Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill Inc
Oliveira, F., & Pasqualini, K. C. (2014). Os dependentes de internet no Brasil: realidade ou mito entre os universitários. Mimesis Bauru, 35(1), 95-140. Recuperado de http://docplayer.com.br/3356503-Os-dependentes-de-internet-no-brasil-realidade-ou-mito-entre-os-universitarios.html
Pasquali, L. (2010). Instrumentação psicológica: Fundamentos e práticas. Porto Alegre, RS: Artmed.
Pezoa-Jares, R. E., Espinola-Luna, I. L., & Vasquez-Medina, J. A. (2012). Internet Addiction: A Review. J Addict Res Ther, 56, 1-10. doi: 10.4172/2155-6105.S6-004
Picon, F., Karam, R., Breda, V., Restano, A., Silveira, A., & Spritzer, D. (2015). Precisamos falar sobre tecnologia: caracterizando clinicamente os subtipos de dependência de tecnologia. Revista brasileira de psicoterapia, 17(2), 44-60. Recuperado de http://rbp.celg.org.br/detalhe_artigo.asp?id=177
Pontes, H. M., Patrão, I. M., & Griffiths, M. D. (2014). Portuguese validation of the Internet Addiction Test: Na empirical study. J Behav Addict, 3(2), 107-114. doi: 10.1556/JBA.3.2014.2.4
Rossel, Y. (2012). Lavaan: na R package for structural equation modeling. Jounal of Statistical Sofware, 48(2), 1-36. doi: 10.18637/jss.v048.i02
Salgado, P. G., Boubeta, A. R., Tobío, T. B., Malou, J. V., & Couto, C. B. (2014). Evaluation and early detection of problematic Internet use in adolescentes. Psicothema, 26(1), 21-26. doi: 10.7334/psicothema2013.109
Sasmaz, T., Oner, S., Kurt, A. O., Yapici, G., Yazici, A. E., Buqdayci, R., & Sis, M. (2014). Prevalence and risk factors of Internet addiction in high school students. European Journal of Public Health, 24(1), 15-20. doi:10.1093 / eurpub / ckt051
Secretaria de Comunicação Social da Presidência da República (2015). Pesquisa
Brasileira de Mídia 2015. Hábitos de consumo de Mídia pela população brasileira. Recuperado de: http://www.secom.gov.br/atuacao/pesquisa/lista-de-pesquisas-quantitativas-e-qualitativas-de-contratos-atuais/pesquisa-brasileira-de-midia-pbm-2015.pdf
Silva, H. R., Areco, K. C., Bandiera-Paiva, P., Galvão, P. V., Garcia, A, N., & Silveira, D. X. (2014). Avaliação da equivalência semântica da versão em português (Brasil) da Online Cognition Scale. Caderno Saude Publica, 30(6), 1327-34. doi: 10.1590/0102-311X00153413
Sousa, V., & Rojjanasrirat, W. (2010). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268-274. doi: 10.1111/j.1365-2753.2010.01434.x
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6ªed.). Nova Iorque: Allyn & Bacon.
Tsitsika, A., Critselis, E., Janikian, M., Kormas, G., & Kafetzis, D. A. (2011). Association Between Internet Gambling and Problematic Internet Use Among Adolescents. Journal of Gambling Studies, 27, 389–400. doi: 10.1007/s10899-010-9223-z
Wallace, P. (2014). Internet addiction disorder and youth: There are growing concerns about compulsive online activity and that this could impede students’ performance and social Ilves. EMBO Rep, 15(1), 12-6. doi: 10.1002/embr.201338222
Widyanto, L., & McMurran, M. (2004). The psychometic properties of the internet addiction test. Cyberpsychology Behav, 7(4), 443-450. doi: 10.1089/cpb.2004.7.443
Published
2018-10-23
How to Cite
Nunes da Fonsêca, P., Neves Couto, R., Cândido do Vale Melo, C., de Oliveira Silva Machado, M., & Farias de Souza Filho, J. (2018). Scale of problematic internet use in university students: evidence of validity and reliability. Ciencias Psicológicas, 12(2), 223–230. https://doi.org/10.22235/cp.v12i2.1686
Issue
Section
ORIGINAL ARTICLES
