Construcción de un banco de ítems de facetas de neuroticismo para el desarrollo de un test adaptativo

  • Facundo Juan Pablo Abal Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET) y Universidad de Buenos Aires
  • Sofía Esmeralda Auné Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET) y Universidad de Buenos Aires
  • Horacio Félix Attorresi Universidad de Buenos Aires
Palabras clave: neuroticismo, modelo de lo cinco factores, banco de ítems, test adaptativo informatizado, teoría de respuesta al ítem

Resumen

El objetivo de este trabajo fue elaborar un banco de ítems para medir las facetas del Neuroticismo basado en el Modelo de los Cinco Factores (McCrae & Costa, 2010) y examinar la viabilidad de una administración adaptativa. Se inició con un pool de 90 ítems, que fue reducido a 54 (nueve por faceta) por juicio experto y estudio piloto. La versión depurada se administró a 1147 adultos de población general del área metropolitana de Buenos Aires (52.7% mujeres). Un 70% de los casos se usó para: a) calibrar los ítems de cada faceta por separado con el Modelo de Respuesta Graduada de Samejima (2010), b) estudiar la estructura interna del banco con un Análisis Factorial Confirmatorio y c) obtener evidencias de validez concurrente. El alfa ordinal de las facetas osciló entre .76 y .87. Con el 30% restante de casos se efectuó una simulación de administración adaptativa con criterio de parada de error ≤ 0.50. Se concluye que el banco reúne evidencias de validez y confiabilidad aceptables para su administración en un formato convencional, pero se necesita incorporar más ítems si se pretende optimizar la medición de las facetas Impulsividad, Vulnerabilidad y Hostilidad.

Citas

Abal, F. J. P., Auné, S. E., Lozzia, G. S. & Attorresi, H. F. (2017). Funcionamiento de la categoría central en ítems de Confianza para la Matemática. Evaluar, 17(2), 18-31.

Abal, F. J. P., Lozzia, G. S., Aguerri, M. E., Galibert, M. S. & Attorresi, H.F. (2010). La escasa aplicación de la Teoría de Respuesta al Ítem en Tests de Ejecución Típica. Revista Colombiana de Psicología, 19(1) 111-122.

Baldasaro, R. E., Shanahan, M. J., & Bauer, D. J. (2013). Psychometric Properties of the Mini-IPIP in a Large, Nationally Representative Sample of Young Adults. Journal of Personality Assessment, 95(1), 74–84. https://doi.org/10.1080/00223891.2012.700466

Byrne, B. M. (2012). Structural equation modeling with Mplus: Basics, concepts, applications, and programming. New York: Routledge.

Caprara, G. V., Barbaranelli, C., Borgogni, L., & Vecchione, M. (2007). BFQ: Manuale. Firenze: OS.

Casullo, M. (2004). Síntomas psicopatológicos en adultos urbanos. Psicología y Ciencia Social, 6(1), 49-57.

Choi, S. W. (2009). Firestar: Computerized Adaptive Testing Simulation Program for Polytomous Item Response Theory Models. Applied Psychological Measurement, 33(8), 644-645. https://doi.org/10.1177/0146621608329892

Costa, P. T. & McCrae, R. R. (2008). Inventario de Personalidad NEO Revisado (NEO PI-R). Inventario NEO reducido de Cinco Factores (NEO-FFI). Manual. 3ª edición. Madrid: TEA.

Credé, M., Harms, P., Niehorster, S., & Gaye-Valentine, A. (2012). An evaluation of the consequences of using short measures of the Big Five personality traits. Journal of Personality and Social Psychology, 102(4), 874–888. https://doi.org/10.1037/a0027403

Cupani, M., Pilatti, A., Urrizaga, A., Chincolla, A. & Richaud, M. C. (2014). Inventario de personalidad IPIP-NEO: estudios preliminares de adaptación al español en estudiantes argentinos. Revista Mexicana de Investigación en Psicología, 6(1), 55-73.

Derogatis, L. (1994). SCL-90-R. Symptom Checklist-90-R. Administration, Scoring and Procedures Manual. Minneapolis: National Computer System.

DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of Item Candidates. The PROMIS. Qualitative Item Review. Medical Care, 45(5), 12-21. https://doi.org/10.1097/01.mlr.0000254567.79743.e2

Digman, J. M. (1990). Personality structure: Emergence of the five-factor model. Annual Review of Psychology, 41, 417–440. https://doi.org/10.1146/annurev.ps.41.020190.002221

Donnellan, M. B., Oswald, F. L., Baird, B. M., & Lucas, R. E. (2006). The Mini-IPIP scales: Tiny-yet-effective measures of the big five factors of personality. Psychological Assessment, 18(2), 192–203. https://doi.org/10.1037/1040-3590.18.2.192

Drake, M. M., Morris, D. & Davis, T. J. (2017). Neuroticism's susceptibility to distress: Moderated with mindfulness. Personality and Individual Differences, 106, 248-252. https://doi.org/10.1016/j.paid.2016.10.060

Drasgow, F., Levine, M. V., Tsien, S., Williams B. A., & Mead, A. D. (1995). Fitting polytomous item response theory models to multiple-choice tests. Applied Psychological Measurement, 19(2), 143-165. https://doi.org/10.1177/014662169501900203

Drasgow, F., Stark, S., Chernyshenko, O. S., Nye, C. D., Hulin, C. L., & White, L. A. (2012). Development of the to support Army selection and classification decisions (Tech. Rep. No. 1311). Arlington, VA: U.S. Army Research.

Elosua, P. & Zumbo, B.D. (2008). Coeficientes de fiabilidad para escalas de respuesta categórica ordenada. Psicothema, 20(4), 896-901.

Eysenck, H. J. & Eysenck, S. B. G. (1994). Manual of the Eysenck Personality Questionnaire. California: EdITS/Educational and Industrial Testing Service.

Ferrando, P. J. (2001). The measurement of neuroticism using MMQ, MPI, EPI and EPQ items: a psychometric analysis based on item response theory. Personality and Individual Differences, 30, 641-656. https://doi.org/10.1016/S0191-8869(00)00062-3

Forbey, J. D. & Ben-Porath, Y. S. (2007). Computerized Adaptive Personality Testing: A Review and Illustration With the MMPI-2 Computerized Adaptive Version. Psychological Assessment, 19(1), 14 - 24. https://doi.org/10.1037/1040-3590.19.1.14

Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48, 26-34. https://doi.org/10.1037/0003-066X.48.1.26

Goldberg, L. R. (1999). A broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several five-factor models. En I. Mervielde, I. Deary, F. De Fruyt, y F. Ostendorf (Eds.), Personality Psychology in Europe, (Vol. 7, pp. 7-28). Tilburg: Tilburg University Press.

Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C.,Cloninger, C. R., & Gough, H. C. (2006). The Personality Item Pool and the future of public-domain personality measures. Journal of Research in Personality, 40, 84–96. https://doi.org/10.1016/j.jrp.2005.08.007

Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003). A very brief measure of the Big-Five personality domains. Journal of Research in Personality, 37, 504–528. https://doi.org/10.1016/S0092-6566(03)00046-1

Hajek, A., Bock, J. O. & König, H.H. (2017). The role of personality in health care use: Results of a population-based longitudinal study in Germany. PLoS One, 12(7):e0181716. https://doi.org/10.1371/journal.pone.0181716

Hengartner, M. P., Kawohl, W., Haker, H., Rössler, W., & Ajdacic-Gross, V. (2016). Big Five personality traits may inform public health policy and preventive medicine: Evidence from a cross-sectional and a prospective longitudinal epidemiologic study in a Swiss community. Journal of Psychosomatic Research, 84, 44-51. https://doi.org/10.1016/j.jpsychores.2016.03.012

Jeronimus, B. F., Kotov, R., Riese, H. & Ormel, J. (2016). Neuroticism’s prospective association with mental disorders halves after adjustment for baseline symptoms and psychiatric history, but the adjusted association hardly decays with time: a meta-analysis on 59 longitudinal/prospective studies with 443 313 participants. Psychological Medicine, 46(14), 2883-2906. https://doi.org/10.1017/S0033291716001653

Johnson, J. A. (2014). Measuring thirty facets of the Five Factor Model with a 120-item public domain inventory: Development of the IPIP-NEO-120. Journal of Research in Personality, 51, 78-89. https://doi.org/10.1016/j.jrp.2014.05.003

Lahey, B. B. (2009). Public health significance of neuroticism. American Psychologist, 64, 241–256. https://doi.org/10.1037/a0015309

Lozano, L. M., García-Cueto, E. & Muñiz, J. (2008). Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales. Methodology, 4(2), 73–79. https://doi.org/10.1027/1614-2241.4.2.73

Makransky, G., Mortensen, E. L., & Glas, C. A. (2013). Improving personality facet scores with multidimensional computer adaptive testing: An illustration with the NEO PI-R. Assessment, 20, 3-13. https://doi.org/10.1177/1073191112437756

McCrae, R. R. & Costa, P. T. (2003). Personality in Adulthood, Second Edition: A Five-Factor Theory Perspective. New York: Guilford Press. https://doi.org/10.4324/9780203428412

McCrae, R. R. & Costa P. T. (2010). NEO Inventories professional manual. Odessa, FL: Psychological Assessment Resources.

McCrae, R. R., Kurtz, J. E., Yamagata, S. & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15(1), 28-50. https://doi.org/10.1177/1088868310366253

Milojev, P., Osborne, D., Greaves, L. M., Barlow, F. K. & Sibley, C. G. (2013). The Mini-IPIP6: Tiny yet highly stable markers of Big Six personality. Journal of Research in Personality, 47, 936–944. https://doi.org/10.1016/j.jrp.2013.09.004

Morizot, J. (2014). Construct Validity of Adolescents' Self-Reported Big Five Personality Traits: Importance of Conceptual Breadth and Initial Validation of a Short Measure. Assessment, 21(5), 580-606. https://doi.org/10.1177/1073191114524015

Muthén, L. & Muthén, B. (2010). Mplus User’s Guide, 6th Edn. Los Angeles, CA: Muthén y Muthén.

Nieto, M. D., Abad, F. J., Hernández-Camacho, A., Garrido, L. E., Barrada, J. R., Aguado, D. & Olea, J. (2017). Calibrating a new item pool to adaptively assess the Big Five. Psicothema, 29(3), 390-395.

Norman, W. T. (1963). Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings. The Journal of Abnormal and Social Psychology, 66(6), 574-583. http://dx.doi.org/10.1037/h0040291

Olea, J. & Ponsoda, V. (2013). Tests adaptativos informatizados. Madrid: Ediciones UNED.

Ormel, J., Bastiaansen, A., Riese, H., Bos, E. H., Servaas, M., Ellenbogen, M., … Aleman, A. (2013). The biological and psychological basis of neuroticism: Current status and future directions. Neuroscience and Biobehavioral Reviews, 37, 59–72. https://doi.org/10.1016/j.neubiorev.2012.09.004

Paap, M. C. S., Kroeze, K. A., Glas, C. A. W., Terwee, C. B., van der Palen, J. & Veldkamp, B. P. (2017). Measuring Patient-Reported Outcomes Adaptively: Multidimensionality Matters! Applied Psychological Measurement, 42(5), 327-342. https://doi.org/10.1177/0146621617733954

Paunonen, S. V., Haddock, G., Forsterling F., & Keinonen M. (2003). Broad versus narrow personality measures and the prediction of behaviour across cultures. Europe Journal of Personality, 17, 413–433. https://doi.org/10.1002/per.496

Penfield, R. D. & Giacobbi, P. R. (2004). Applying a Score Confidence Interval to Aiken's Item Content-Relevance Index. Measurement in Physical Education and Exercise Science, 8(4), 213-225. https://doi.org/10.1207/s15327841mpee0804_3

Peters, G. J. Y. (2014). The alpha and the omega of scale reliability and validity: Why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality. European Health Psychologist, 16(2), 56–69.

Reise, S. P. & Henson, J. M. (2000). Computerization and adaptive administration of the NEO PI-R. Assessment, 7, 347-364. https://doi.org/10.1177/107319110000700404

Reise, S. P. & Revicki, D. A. (2015). Handbook of Item Response Theory Modeling Applications to Typical Performance Assessment. Nueva York: Routledge

Reise, S. P. & Rodriguez, A. (2016). Item response theory and the measurement of psychiatric constructs: some empirical and conceptual issues and challenges. Psychological Medicine, 46(10), 2025-2039. https://doi.org/10.1017/S0033291716000520

Reise, S. P. & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48. https://doi.org/10.1146/annurev.clinpsy.032408.153553

Rubio, V. J., Aguado, D., Hontangas, P. M. & Hernández, J. M. (2007). Psychometric Properties of an Emotional Adjustment Measure. An Application of the Graded Response Model. European Journal of Psychological Assessment, 23(1), 39-46. https://doi.org/10.1027/1015-5759.23.1.39

Samejima, F. (2010). Graded Response Model. En W. J. van der Linden (Ed.), Handbook of Item Response Theory, Volume 1: Models (pp. 95-108). Boca Raton: Chapman y Hall/CRC.

Sanchez, R. O. & Ledesma, R.D. (2009). Análisis psicométrico del Inventario de Síntomas Revisado (SCL-90-r) en población clínica. Revista Argentina de Clínica Psicológica, XVIII, 265-274.

Sanz, J. & García-Vera, M. P. (2009). Nuevos Baremos para la Adaptación Española del Inventario de Personalidad NEO Revisado (NEO PI-R): Fiabilidad y Datos Normativos en Voluntarios de la Población General. Clínica y Salud, 20(2), 131-144.

Sauer-Zavala, S., Wilner, J. & Barlow, D. H. (2017). Addressing neuroticism in psychological treatment. Personality Disorders: Theory, Research, and Treatment, 8(3), 191-198. https://doi.org/10.1037/per0000224

Sibley, C. G. (2012). The Mini-IPIP6: Item Response Theory analysis of a short measure of the big-six factors of personality in New Zealand. New Zealand Journal of Psychology, 41(3), 21-31.

Simms, L., Williams, T. F. & Simms, E. N. (2017). Assessment of the Five Factor Model. En T. A. Widiger (Ed.) The Oxford Handbook of the Five Factor Model (pp. 353-380). New York: Oxford University Press

Smith, L. (2002). On the usefulness of item bias analysis to personality psychology. Personality and Social Psychology Bulletin, 28, 754-763. https://doi.org/10.1177/0146167202289005

Smits, N., Cuijpers, P., & van Straten, A. (2011). Applying computerized adaptive testing to the CES-D scale: A simulation study. Psychiatry Research, 188(1), 147-155. https://doi.org/10.1016/j.psychres.2010.12.001

Smits, N., Paap, M. C. S., & Böhnke, J. R. (2018). Some recommendations for developing multidimensional computerized adaptive tests for patient-reported outcomes. Quality of Life Research, 27(4), 1055-1063. https://doi.org/10.1007/s11136-018-1821-8

Soto, C. J. & John. O. P. (2017a). Short and extra-short forms of the Big Five Inventory–2: The BFI-2-S and BFI-2-XS. Journal of Research in Personality, 68, 69–81. https://doi.org/10.1016/j.jrp.2017.02.004

Soto, C. J. & John, O. P. (2017b). The Next Big Five Inventory (BFI2): Developing and Assessing a Hierarchical Model With 15 Facets to Enhance Bandwidth, Fidelity, and Predictive Power. Journal of Personality and Social Psychology, 110(3), 117 - 143. https://doi.org/10.1037/pspp0000096

Squillace, M., Picón Janeiro, J., & Schmidt, V. (2013). Adaptación local del Cuestionario Revisado de Personalidad de Eysenck. Evaluar, 13, 19 – 37.

Stark, S. (2001). MODFIT: A computer program for model-data fit. Manuscrito no publicado. University of Illinois: Urbana-Champaign.

Tackett, J. L. & Lahey, B. B. (2017). Neuroticism. En T. A. Widiger (Ed). The Oxford handbook of the five factor model. New York: Oxford University Press.

Taylor, N. & De Bruin, G.P. (2006). BTI. Manual of the Basic Traits Inventory. Johannesburgo, Sudáfrica: JvR

Thissen, D. (2003). MULTILOG. Chicago: Scientific Software International.

Tu, D., Han, Y., Cai, Y., & Gao, X. (2018). Item Selection Methods in Multidimensional Computerized Adaptive Testing With Polytomously Scored Items. Applied Psychological Measurement, 48(8), 677-694. https://doi.org/10.1177/0146621618762748

Vittengl, J. R. (2017). Who pays the price for high neuroticism? Moderators of longitudinal risks for depression and anxiety. Psychological Medicine, 1-12. https://doi.org/10.1017/S0033291717000253

Wang, C., Chang, H. H., & Boughton, K. A. (2013). Deriving stopping rules for multidimensional computerized adaptive testing. Applied Psychological Measurement, 37(2), 99–122. https://doi.org/10.1177/0146621612463422

Watson, D., Nus, E., & Wu, K. D. (2017). Development and Validation of the Faceted Inventory of the Five-Factor Model (FI-FFM). Assessment, 1–28.

Widiger, T. A. (2009). Neuroticism. En M. R. Leary & R. H. Hoyle (Eds.), Handbook of individual differences in social behavior (pp. 129-146). New York; Guilford Press.

Widiger, T. A. & Oltmanns, J. R. (2017). Neuroticism is a fundamental domain of personality with enormous public health implications. World Psychiatry, 16 (2), 144–145. https://doi.org/10.1002/wps.20411

Yao, L. (2013). Comparing the performance of five multidimensional CAT selection procedures with different stopping rules. Applied Psychological Measurement, 37(1), 3–23. https://doi.org/10.1177/0146621612455687

Ziegler, M., Kemper, C. J., & Kruyen, P. (2014). Short scales – Five misunderstandings and ways to overcome them. Journal of Individual Differences, 35(4), 185-189. https://doi.org/10.1027/1614-0001/a000148

Publicado
2019-06-01
Cómo citar
Abal, F. J. P., Auné, S. E., & Attorresi, H. F. (2019). Construcción de un banco de ítems de facetas de neuroticismo para el desarrollo de un test adaptativo. Psicodebate, 19(1), 31-50. https://doi.org/10.18682/pd.v19i1.854