Construcción de un banco de ítems de facetas de neuroticismo para el desarrollo de un test adaptativo
Resumen
El objetivo de este trabajo fue elaborar un banco de ítems para medir las facetas del Neuroticismo basado en el Modelo de los Cinco Factores (McCrae & Costa, 2010) y examinar la viabilidad de una administración adaptativa. Se inició con un pool de 90 ítems, que fue reducido a 54 (nueve por faceta) por juicio experto y estudio piloto. La versión depurada se administró a 1147 adultos de población general del área metropolitana de Buenos Aires (52.7% mujeres). Un 70% de los casos se usó para: a) calibrar los ítems de cada faceta por separado con el Modelo de Respuesta Graduada de Samejima (2010), b) estudiar la estructura interna del banco con un Análisis Factorial Confirmatorio y c) obtener evidencias de validez concurrente. El alfa ordinal de las facetas osciló entre .76 y .87. Con el 30% restante de casos se efectuó una simulación de administración adaptativa con criterio de parada de error ≤ 0.50. Se concluye que el banco reúne evidencias de validez y confiabilidad aceptables para su administración en un formato convencional, pero se necesita incorporar más ítems si se pretende optimizar la medición de las facetas Impulsividad, Vulnerabilidad y Hostilidad.
Descargas
Citas
Abal, F. J. P., Auné, S. E., Lozzia, G. S. & Attorresi, H. F. (2017). Funcionamiento de la categoría central en ítems de Confianza para la Matemática. Evaluar, 17(2), 18-31.
Abal, F. J. P., Lozzia, G. S., Aguerri, M. E., Galibert, M. S. & Attorresi, H.F. (2010). La escasa aplicación de la Teoría de Respuesta al Ítem en Tests de Ejecución Típica. Revista Colombiana de Psicología, 19(1) 111-122.
Baldasaro, R. E., Shanahan, M. J., & Bauer, D. J. (2013). Psychometric Properties of the Mini-IPIP in a Large, Nationally Representative Sample of Young Adults. Journal of Personality Assessment, 95(1), 74–84. https://doi.org/10.1080/00223891.2012.700466
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basics, concepts, applications, and programming. New York: Routledge.
Caprara, G. V., Barbaranelli, C., Borgogni, L., & Vecchione, M. (2007). BFQ: Manuale. Firenze: OS.
Casullo, M. (2004). Síntomas psicopatológicos en adultos urbanos. Psicología y Ciencia Social, 6(1), 49-57.
Choi, S. W. (2009). Firestar: Computerized Adaptive Testing Simulation Program for Polytomous Item Response Theory Models. Applied Psychological Measurement, 33(8), 644-645. https://doi.org/10.1177/0146621608329892
Costa, P. T. & McCrae, R. R. (2008). Inventario de Personalidad NEO Revisado (NEO PI-R). Inventario NEO reducido de Cinco Factores (NEO-FFI). Manual. 3ª edición. Madrid: TEA.
Credé, M., Harms, P., Niehorster, S., & Gaye-Valentine, A. (2012). An evaluation of the consequences of using short measures of the Big Five personality traits. Journal of Personality and Social Psychology, 102(4), 874–888. https://doi.org/10.1037/a0027403
Cupani, M., Pilatti, A., Urrizaga, A., Chincolla, A. & Richaud, M. C. (2014). Inventario de personalidad IPIP-NEO: estudios preliminares de adaptación al español en estudiantes argentinos. Revista Mexicana de Investigación en Psicología, 6(1), 55-73.
Derogatis, L. (1994). SCL-90-R. Symptom Checklist-90-R. Administration, Scoring and Procedures Manual. Minneapolis: National Computer System.
DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of Item Candidates. The PROMIS. Qualitative Item Review. Medical Care, 45(5), 12-21. https://doi.org/10.1097/01.mlr.0000254567.79743.e2
Digman, J. M. (1990). Personality structure: Emergence of the five-factor model. Annual Review of Psychology, 41, 417–440. https://doi.org/10.1146/annurev.ps.41.020190.002221
Donnellan, M. B., Oswald, F. L., Baird, B. M., & Lucas, R. E. (2006). The Mini-IPIP scales: Tiny-yet-effective measures of the big five factors of personality. Psychological Assessment, 18(2), 192–203. https://doi.org/10.1037/1040-3590.18.2.192
Drake, M. M., Morris, D. & Davis, T. J. (2017). Neuroticism's susceptibility to distress: Moderated with mindfulness. Personality and Individual Differences, 106, 248-252. https://doi.org/10.1016/j.paid.2016.10.060
Drasgow, F., Levine, M. V., Tsien, S., Williams B. A., & Mead, A. D. (1995). Fitting polytomous item response theory models to multiple-choice tests. Applied Psychological Measurement, 19(2), 143-165. https://doi.org/10.1177/014662169501900203
Drasgow, F., Stark, S., Chernyshenko, O. S., Nye, C. D., Hulin, C. L., & White, L. A. (2012). Development of the to support Army selection and classification decisions (Tech. Rep. No. 1311). Arlington, VA: U.S. Army Research.
Elosua, P. & Zumbo, B.D. (2008). Coeficientes de fiabilidad para escalas de respuesta categórica ordenada. Psicothema, 20(4), 896-901.
Eysenck, H. J. & Eysenck, S. B. G. (1994). Manual of the Eysenck Personality Questionnaire. California: EdITS/Educational and Industrial Testing Service.
Ferrando, P. J. (2001). The measurement of neuroticism using MMQ, MPI, EPI and EPQ items: a psychometric analysis based on item response theory. Personality and Individual Differences, 30, 641-656. https://doi.org/10.1016/S0191-8869(00)00062-3
Forbey, J. D. & Ben-Porath, Y. S. (2007). Computerized Adaptive Personality Testing: A Review and Illustration With the MMPI-2 Computerized Adaptive Version. Psychological Assessment, 19(1), 14 - 24. https://doi.org/10.1037/1040-3590.19.1.14
Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48, 26-34. https://doi.org/10.1037/0003-066X.48.1.26
Goldberg, L. R. (1999). A broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several five-factor models. En I. Mervielde, I. Deary, F. De Fruyt, y F. Ostendorf (Eds.), Personality Psychology in Europe, (Vol. 7, pp. 7-28). Tilburg: Tilburg University Press.
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C.,Cloninger, C. R., & Gough, H. C. (2006). The Personality Item Pool and the future of public-domain personality measures. Journal of Research in Personality, 40, 84–96. https://doi.org/10.1016/j.jrp.2005.08.007
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003). A very brief measure of the Big-Five personality domains. Journal of Research in Personality, 37, 504–528. https://doi.org/10.1016/S0092-6566(03)00046-1
Hajek, A., Bock, J. O. & König, H.H. (2017). The role of personality in health care use: Results of a population-based longitudinal study in Germany. PLoS One, 12(7):e0181716. https://doi.org/10.1371/journal.pone.0181716
Hengartner, M. P., Kawohl, W., Haker, H., Rössler, W., & Ajdacic-Gross, V. (2016). Big Five personality traits may inform public health policy and preventive medicine: Evidence from a cross-sectional and a prospective longitudinal epidemiologic study in a Swiss community. Journal of Psychosomatic Research, 84, 44-51. https://doi.org/10.1016/j.jpsychores.2016.03.012
Jeronimus, B. F., Kotov, R., Riese, H. & Ormel, J. (2016). Neuroticism’s prospective association with mental disorders halves after adjustment for baseline symptoms and psychiatric history, but the adjusted association hardly decays with time: a meta-analysis on 59 longitudinal/prospective studies with 443 313 participants. Psychological Medicine, 46(14), 2883-2906. https://doi.org/10.1017/S0033291716001653
Johnson, J. A. (2014). Measuring thirty facets of the Five Factor Model with a 120-item public domain inventory: Development of the IPIP-NEO-120. Journal of Research in Personality, 51, 78-89. https://doi.org/10.1016/j.jrp.2014.05.003
Lahey, B. B. (2009). Public health significance of neuroticism. American Psychologist, 64, 241–256. https://doi.org/10.1037/a0015309
Lozano, L. M., García-Cueto, E. & Muñiz, J. (2008). Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales. Methodology, 4(2), 73–79. https://doi.org/10.1027/1614-2241.4.2.73
Makransky, G., Mortensen, E. L., & Glas, C. A. (2013). Improving personality facet scores with multidimensional computer adaptive testing: An illustration with the NEO PI-R. Assessment, 20, 3-13. https://doi.org/10.1177/1073191112437756
McCrae, R. R. & Costa, P. T. (2003). Personality in Adulthood, Second Edition: A Five-Factor Theory Perspective. New York: Guilford Press. https://doi.org/10.4324/9780203428412
McCrae, R. R. & Costa P. T. (2010). NEO Inventories professional manual. Odessa, FL: Psychological Assessment Resources.
McCrae, R. R., Kurtz, J. E., Yamagata, S. & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15(1), 28-50. https://doi.org/10.1177/1088868310366253
Milojev, P., Osborne, D., Greaves, L. M., Barlow, F. K. & Sibley, C. G. (2013). The Mini-IPIP6: Tiny yet highly stable markers of Big Six personality. Journal of Research in Personality, 47, 936–944. https://doi.org/10.1016/j.jrp.2013.09.004
Morizot, J. (2014). Construct Validity of Adolescents' Self-Reported Big Five Personality Traits: Importance of Conceptual Breadth and Initial Validation of a Short Measure. Assessment, 21(5), 580-606. https://doi.org/10.1177/1073191114524015
Muthén, L. & Muthén, B. (2010). Mplus User’s Guide, 6th Edn. Los Angeles, CA: Muthén y Muthén.
Nieto, M. D., Abad, F. J., Hernández-Camacho, A., Garrido, L. E., Barrada, J. R., Aguado, D. & Olea, J. (2017). Calibrating a new item pool to adaptively assess the Big Five. Psicothema, 29(3), 390-395.
Norman, W. T. (1963). Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings. The Journal of Abnormal and Social Psychology, 66(6), 574-583. http://dx.doi.org/10.1037/h0040291
Olea, J. & Ponsoda, V. (2013). Tests adaptativos informatizados. Madrid: Ediciones UNED.
Ormel, J., Bastiaansen, A., Riese, H., Bos, E. H., Servaas, M., Ellenbogen, M., … Aleman, A. (2013). The biological and psychological basis of neuroticism: Current status and future directions. Neuroscience and Biobehavioral Reviews, 37, 59–72. https://doi.org/10.1016/j.neubiorev.2012.09.004
Paap, M. C. S., Kroeze, K. A., Glas, C. A. W., Terwee, C. B., van der Palen, J. & Veldkamp, B. P. (2017). Measuring Patient-Reported Outcomes Adaptively: Multidimensionality Matters! Applied Psychological Measurement, 42(5), 327-342. https://doi.org/10.1177/0146621617733954
Paunonen, S. V., Haddock, G., Forsterling F., & Keinonen M. (2003). Broad versus narrow personality measures and the prediction of behaviour across cultures. Europe Journal of Personality, 17, 413–433. https://doi.org/10.1002/per.496
Penfield, R. D. & Giacobbi, P. R. (2004). Applying a Score Confidence Interval to Aiken's Item Content-Relevance Index. Measurement in Physical Education and Exercise Science, 8(4), 213-225. https://doi.org/10.1207/s15327841mpee0804_3
Peters, G. J. Y. (2014). The alpha and the omega of scale reliability and validity: Why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality. European Health Psychologist, 16(2), 56–69.
Reise, S. P. & Henson, J. M. (2000). Computerization and adaptive administration of the NEO PI-R. Assessment, 7, 347-364. https://doi.org/10.1177/107319110000700404
Reise, S. P. & Revicki, D. A. (2015). Handbook of Item Response Theory Modeling Applications to Typical Performance Assessment. Nueva York: Routledge
Reise, S. P. & Rodriguez, A. (2016). Item response theory and the measurement of psychiatric constructs: some empirical and conceptual issues and challenges. Psychological Medicine, 46(10), 2025-2039. https://doi.org/10.1017/S0033291716000520
Reise, S. P. & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48. https://doi.org/10.1146/annurev.clinpsy.032408.153553
Rubio, V. J., Aguado, D., Hontangas, P. M. & Hernández, J. M. (2007). Psychometric Properties of an Emotional Adjustment Measure. An Application of the Graded Response Model. European Journal of Psychological Assessment, 23(1), 39-46. https://doi.org/10.1027/1015-5759.23.1.39
Samejima, F. (2010). Graded Response Model. En W. J. van der Linden (Ed.), Handbook of Item Response Theory, Volume 1: Models (pp. 95-108). Boca Raton: Chapman y Hall/CRC.
Sanchez, R. O. & Ledesma, R.D. (2009). Análisis psicométrico del Inventario de Síntomas Revisado (SCL-90-r) en población clínica. Revista Argentina de Clínica Psicológica, XVIII, 265-274.
Sanz, J. & García-Vera, M. P. (2009). Nuevos Baremos para la Adaptación Española del Inventario de Personalidad NEO Revisado (NEO PI-R): Fiabilidad y Datos Normativos en Voluntarios de la Población General. Clínica y Salud, 20(2), 131-144.
Sauer-Zavala, S., Wilner, J. & Barlow, D. H. (2017). Addressing neuroticism in psychological treatment. Personality Disorders: Theory, Research, and Treatment, 8(3), 191-198. https://doi.org/10.1037/per0000224
Sibley, C. G. (2012). The Mini-IPIP6: Item Response Theory analysis of a short measure of the big-six factors of personality in New Zealand. New Zealand Journal of Psychology, 41(3), 21-31.
Simms, L., Williams, T. F. & Simms, E. N. (2017). Assessment of the Five Factor Model. En T. A. Widiger (Ed.) The Oxford Handbook of the Five Factor Model (pp. 353-380). New York: Oxford University Press
Smith, L. (2002). On the usefulness of item bias analysis to personality psychology. Personality and Social Psychology Bulletin, 28, 754-763. https://doi.org/10.1177/0146167202289005
Smits, N., Cuijpers, P., & van Straten, A. (2011). Applying computerized adaptive testing to the CES-D scale: A simulation study. Psychiatry Research, 188(1), 147-155. https://doi.org/10.1016/j.psychres.2010.12.001
Smits, N., Paap, M. C. S., & Böhnke, J. R. (2018). Some recommendations for developing multidimensional computerized adaptive tests for patient-reported outcomes. Quality of Life Research, 27(4), 1055-1063. https://doi.org/10.1007/s11136-018-1821-8
Soto, C. J. & John. O. P. (2017a). Short and extra-short forms of the Big Five Inventory–2: The BFI-2-S and BFI-2-XS. Journal of Research in Personality, 68, 69–81. https://doi.org/10.1016/j.jrp.2017.02.004
Soto, C. J. & John, O. P. (2017b). The Next Big Five Inventory (BFI2): Developing and Assessing a Hierarchical Model With 15 Facets to Enhance Bandwidth, Fidelity, and Predictive Power. Journal of Personality and Social Psychology, 110(3), 117 - 143. https://doi.org/10.1037/pspp0000096
Squillace, M., Picón Janeiro, J., & Schmidt, V. (2013). Adaptación local del Cuestionario Revisado de Personalidad de Eysenck. Evaluar, 13, 19 – 37.
Stark, S. (2001). MODFIT: A computer program for model-data fit. Manuscrito no publicado. University of Illinois: Urbana-Champaign.
Tackett, J. L. & Lahey, B. B. (2017). Neuroticism. En T. A. Widiger (Ed). The Oxford handbook of the five factor model. New York: Oxford University Press.
Taylor, N. & De Bruin, G.P. (2006). BTI. Manual of the Basic Traits Inventory. Johannesburgo, Sudáfrica: JvR
Thissen, D. (2003). MULTILOG. Chicago: Scientific Software International.
Tu, D., Han, Y., Cai, Y., & Gao, X. (2018). Item Selection Methods in Multidimensional Computerized Adaptive Testing With Polytomously Scored Items. Applied Psychological Measurement, 48(8), 677-694. https://doi.org/10.1177/0146621618762748
Vittengl, J. R. (2017). Who pays the price for high neuroticism? Moderators of longitudinal risks for depression and anxiety. Psychological Medicine, 1-12. https://doi.org/10.1017/S0033291717000253
Wang, C., Chang, H. H., & Boughton, K. A. (2013). Deriving stopping rules for multidimensional computerized adaptive testing. Applied Psychological Measurement, 37(2), 99–122. https://doi.org/10.1177/0146621612463422
Watson, D., Nus, E., & Wu, K. D. (2017). Development and Validation of the Faceted Inventory of the Five-Factor Model (FI-FFM). Assessment, 1–28.
Widiger, T. A. (2009). Neuroticism. En M. R. Leary & R. H. Hoyle (Eds.), Handbook of individual differences in social behavior (pp. 129-146). New York; Guilford Press.
Widiger, T. A. & Oltmanns, J. R. (2017). Neuroticism is a fundamental domain of personality with enormous public health implications. World Psychiatry, 16 (2), 144–145. https://doi.org/10.1002/wps.20411
Yao, L. (2013). Comparing the performance of five multidimensional CAT selection procedures with different stopping rules. Applied Psychological Measurement, 37(1), 3–23. https://doi.org/10.1177/0146621612455687
Ziegler, M., Kemper, C. J., & Kruyen, P. (2014). Short scales – Five misunderstandings and ways to overcome them. Journal of Individual Differences, 35(4), 185-189. https://doi.org/10.1027/1614-0001/a000148
Los autores/as que publiquen en esta revista ceden los derechos de autor y de publicación a Psicodebate y aceptan el registro de su trabajo bajo una licencia de atribución de Creative Commons, que permite a terceros utilizar lo publicado siempre que de el crédito pertinente a los autores y a Psicodebate
