Convergent validity of SPARO and MMPI-2 questionnaires

Hynek Cígler ORCID logo
Adéla Rudá

Abstract

In the previous study (Cígler & Rudá, 2021), we were not able to confirm satisfactory internal consistency and factor validity of the SPARO questionnaire. However, further psychometric properties are also necessary to consider the questionnaire's va­lidity and usefulness in practice. In this follow up study, we examined its criterion validity to MMPI-2, which is used globally and thus has broader empirical support. Despite that, we did not find any support for neither convergent nor divergent validity of the main components, general factor, and the credibility score (L) of SPARO questionnaire to selected MMPI-2 scales. The only exception was the emotional variability scale (EM). As a minor result, we also examined the internal consistency and factor validity of MMPI-2 scales as no other Czech study concerning the questionnaire exists. Neither reliability nor factor validity was satisfactory. Finally, we argue that using the SPARO questionnaire in regular practice cannot be recommended. Cautious use of the MMPI-2 is possible, regarding international validation studies, however, further Czech research is needed, especially in the predictive validity.

https://doi.org/10.29364/epsy.392

(Fulltext in Czech)

Keywords

convergent validity, divergent validity, SPARO, MMPI-2, Minnesota Multiphasic Personality Inventory, Police of the Czech Republic, personal selection

Literature

AERA, APA, & NCME. (2014). Standards for Educational and Psychological Testing. American Educational Research Association. Bednárová, B. (2016). Skresľovanie odpovedí v osobnostných dotazníkoch v kontexte výberového konania. Diplomová práce. Masarykova uhiverzita. https://is.muni.cz/th/o0fgs/

Benton, T. (2015). An empirical assessment of Guttman’s lambda 4 reliability coefficient. In R. Millsap, D. Bolt, L. van der Ark, & W. C. Wang (Eds.), Quantitative Psychology Research. Springer Proceedings in Mathematics & Statistics, vol. 89 (pp. 301–310). Springer. https://doi.org/…-319-07503-7

Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., Kaemmer, B., & Netík, K. (2002). MMPI 2: Minnesota Multiphasic Personality Inventory-2.

Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., Kaemmer, B., & Netík, K. (2013). MMPI-2 – Minnesota Multiphasic Personality Inventory-2 : Druhé rozšířené vydání. Testcentrum.

Chalmers, R. P. (2018). On misconceptions and the limited usefulness of ordinal alpha. Educational and Psychological Measurement, 78(6). https://doi.org/…164417727036

Cheng, M. K. (2006). Structural equation modeling of the Restructured Clinical scales of the MMPI-2. Thesis. University of Windsor. https://scholar.uwindsor.ca/etd/7215

Cígler, H., & Rudá, A. (2021). Reliabilita a faktorová validita dotazníku SPARO. E-psychologie, 15(1), 16–39. https://doi.org/…364/epsy.391

Čurdová, J., & Pourová, M. (2019). Minnesota Multiphasic Personality Inventory 2 – Recenze metody. TESTFÓRUM, 7(12), 6. https://doi.org/…019-12-12447

Farnikova, K., Obereigneru, R., Kanovsky, P., & Prasko, J. (2012). Comparison of personality characteristics in Parkinson disease patients with and without impulse control disorders and in healthy volunteers. Cognitive And Behavioral Neurology, 25(1), 25–33. https://doi.org/…3e31824b4103

Friedman, A. F., Bolinskey, P. K., Levak, R. W., & Nichols, D. S. (2015). Psychological assessment with the MMPI-2/MMPI-2-RF (3rd ed.). Routledge.

Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-Type and ordinal Item Response Data: A conceptual, empirical, and practical guide – practical assessment, research & evaluation. Practical Assessment, Research, and Evaluation, 17(3), 1–13. https://doi.org/…75/n560-j767

Green, S. B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74(1), 155–167. https://doi.org/…6-008-9099-3

Greene, R. L. (2000). The MMPI-2: An interpretive manual. Allyn and Bacon.

Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10(4), 255–282. https://doi.org/…7/BF02288892

Hajný, M. (2018). Vybrané psychometrické analýzy dotazníku MMPI-2. Diplomová práce. Masarykova univerzita. https://is.muni.cz/th/b8prs/

Hansmanová, L., Obereignerů, R., & Šmahaj, J. (2007). Psychosomatické aspekty zhoubného nádoru těla děložního. Česká gynekologie, 72(4), 304–308.

Hathaway, S. R., & McKinley, J. C. (1942). Manual for the Minnesota Multiphasic Personality Inventory. University of Minnesota Press.

Hoelzle, J. B., & Meyer, G. J. (2008). The factor structure of the MMPI-2 restructured clinical (RC) scales. Journal of Personality Assessment, 90(5), 443–455. https://doi.org/…890802248711

Jensovsky, J., Ruzicka, E., Spackova, N., & Hejdukova, B. (2002). Changes of event related potentials and cognitive processes in patients with subclinical hypothyroidism after thyroxine treatment. Endocrine Regulations, 36(3), 115–122.

Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2020). semTools: Useful tools for structural equation modeling (0.5–3). https://cran.r-project.org/…age=semTools

Jurišová, E., & Sarmány-Schuller, I. (2013). Structure of basal psychical self-regulation and personality integration in relation to coping strategies in decision-making in paramedics. Studia Psychologica, 55(1), 3–18. https://doi.org/….2013.01.617

Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2014). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. https://doi.org/…124114543236

Kudela, M., & Hansmanová, L. (2014). Psychosomatické aspekty a léčba psychofarmaky v etiopatogenezi karcinomu endometria. Česká gynekologie, 79(5), 378–381.

Lakens, D. (2017). Equivalence tests. Social Psychological and Personality Science, 8(4), 355–362. https://doi.org/…550617697177

Líbalová, Z., Feyereisl, J., Martan, A., Cepický, P., Halaska, M., Krofta, L., Váchová, D., Balcarová, J., & Pecená, M. (2001). Psychologie inkontinence moce. I. Srovnání žen s urgentní a stresovou inkontinencí před zahájením terapie. Česká gynekologie, 66(3), 171–174.

Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley.

Mangiafico, S. (2020). rcompanion: Functions to Support Extension Education Program Evaluation (R package version 2.3.21). https://cran.r-project.org/…e=rcompanion

Mikšík, O. (1992). IHAVEZ – SPIDO – VAROS (příručka). Psychodiagnostika.

Mikšík, O. (2001). Zjišťování bazální struktury a dynamiky autoregulace, integrovanosti a psychické odolnosti osobnosti dotazníky SPARO, BAROM, IHATRANS (manuál). Diaros.

Mikšík, O. (2004). Dotazník SPARO (příručka). Psychodiagnostika.

Mikšík, O. (2007). Psychologická charakteristika osobnosti. Karolinum.

Mikšík, O. (2009). Psychika osobnosti v období závažných životních a společenských změn. Karolinum.

Netík, K. (2003). Příloha C: Složení škál.

Nichols, D. S. (2011). Essentials of MMPI-2 Assessment. John Wiley & Sons, Inc.

Norcross, J. C., Koocher, G. P., & Garofalo, A. (2006). Discredited psychological treatments and tests: A Delphi poll. Professional Psychology: Research and Practice, 37(5), 515–522. https://doi.org/…028.37.5.515

Obereignerů, K., Mareš, J., Obereignerů, R., & Kanovský, P. (2010). The Occurence of Psychogenic Disorders in Neurology. Česká a slovenská neurologie a neurochirurgie, 73(5), 529–533.

Phillips, N. (2017). yarrr: A Companion to the e-Book “YaRrr!: The Pirate’s Guide to R” (R package version 0.1.5). https://cran.r-project.org/package=yarrr

Preiss, J., & Haas, T. (1997). Některé psychometrické charakteristiky české verze Washingtonského psychosociálního dotazníku pro záchvatová onemocnění (WPSI). Československá psychologie, 41(4), 334–346.

Prokopová, P. (2011). Analýza osobnostní struktury uchazeče o službu v profesionálním hasičském záchranném sboru. Diplomová práce. Masarykova univerzita. https://is.muni.cz/th/hny4h/

R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing.

Revelle, W. (2019). psych: Procedures for Personality and Psychological Research (1.9.12). Northwestern University. https://cran.r-project.org/package=psych

Revelle, W., & Zinbarg, R. E. (2009). Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma. Psychometrika, 74(1), 145–154. https://doi.org/…6-008-9102-z

Rose, E. M., Mathew, T., Coss, D. A., Lohr, B., & Omland, K. E. (2018). A new statistical method to test equivalence: an application in male and female eastern bluebird song. Animal Behaviour, 145, 77–85. https://doi.org/….2018.09.004

Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1–36. http://www.jstatsoft.org/v48/i02/

Sellbom, M., Fischler, G. L., & Ben-Porath, Y. S. (2007). Identifying MMPI-2 predictors of police officer integrity and misconduct. Criminal Justice and Behavior, 34(8), 985–1004. https://doi.org/…854807301224

Signorell, A., & et al. (2020). DescTools: Tools for descriptive statistics (R package version 0.99.32). https://cran.r-project.org/…ge=DescTools

Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107–120. https://doi.org/…6-008-9101-0

Spearman, C. (1904). The Proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72. https://doi.org/10.2307/1412159

Stancak, A., Hubova, D., Skorodensky, M., Kollar, J., & Mrinak, J. (1986). Clinical symptomatology of the style of Type A behavior pattern according to the MMPI-100. Studia Psychologica, 28(1), 73–79.

Stříteský, M. (2018). Právní aspekty pracovně psychologické diagnostiky. Testfórum, 6(10), 23–31. https://doi.org/…F2018-10-179

Šucha, M., Šťastná, L., & Zámečník, P. (2017). Osobnostní vlastnosti řidičů řídících pod vlivem alkoholu. Adiktologie, 17(1), 34–44.

Svoboda, M., Řehan, V., Vtípil, Z., Klimusová, H., Humpolíček, P., Urbánek, T., & Kouhoutek, T. (2004). Aplikovaná psychodiagnostika v České republice. MSD.

Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham, J. R., & Kaemmer, B. (2003). MMPI-2 Restructured Clinical (RC) Scales: Development, validation, and interpretation. University of Minnesota Press.

Tellegen, Auke, & Ben-Porath, Y. S. (1992). The new uniform T scores for the MMPI–2: Rationale, derivation, and appraisal. Psychological Assessment, 4(2), 145–155. https://doi.org/…3590.4.2.145

Torchiano, M. (2019). effsize: Efficient Effect Size Computation (R package version 0.7.6). https://doi.org/…nodo.1480624

Urbánek, T. (2010). Nejpoužívanější psychodiagnostické metody v České republice. TESTFÓRUM, 1(1), 6–9. https://doi.org/…7/TF2010-1-3

Wickham, H., & Bryan, J. (2019). readxl: Read Excel Files (R package version 1.3.1). https://cran.r-project.org/package=readxl

Wise, E. A., Streiner, D. L., & Walfish, S. (2010). A review and comparison of the reliabilities of the MMPI-2, MCMI-III, and PAI presented in their respective test manuals. Measurement and Evaluation in Counseling and Development, 42(4), 246–254. https://doi.org/…175609354594

Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for likert rating scales. Journal of Modern Applied Statistical Methods, 6(1), 21–29. https://doi.org/…m/1177992180

Show all Hide