Nový přístup v testování ekvivalence na příkladu měření subjektivního blahobytu

Roč.18,č.1(2021)
Nové přístupy v metodologii sociálněvědního výzkumu

Abstrakt

Survey-based measures of subjective well-being are more and more often analyzed cross-culturally. However, international comparison of these measures requires measurement invariance. Therefore, the major goal of this study was to investigate the cross-country comparability of the five-item subjective well-being scales used in the International Social Survey Programme (2011, 2017). This study applied both the traditional exact and the more recent Bayesian approximate approach to assess whether the subjective well-being scales were measurement invariant. The Bayesian approach detected several non‑invariant items that were problematic for cross-national comparison and could be dropped from the scales. Consequently, measurement invariance was established in all countries for the reduced scales, allowing researchers to meaningfully compare their latent mean scores and the relationships with other theoretical constructs of interest. Thus, the study highlighted the advantages of using multiple indicators and the necessity of measurement invariance testing in subjective well-being research.


Klíčová slova:
subjective well-being; measurement invariance; International Social Survey Programme; MG-BSEM
Reference

ANÝŽOVÁ, Petra. 2014. „Srovnatelnost Schwartzovy hodnotové škály v mezinárodních datech.“ Sociologický časopis/Czech Sociological Review 50(4): 547–580. https://doi.org/10.13060/00380288.2014.50.4.108

ANÝŽOVÁ, Petra. 2015. Srovnatelnost postojových škál v komparativním výzkumu. Olomouc: Univerzita Palackého.

ASPAROUHOV, Tihomir a Bengt MUTHÉN. 2014. „Multiple-Group Factor Analysis Alignment.“ Structural Equation Modeling: A Multidisciplinary Journal 21(4): 495–508. https://doi.org/10.1080/10705511.2014.919210

ASPAROUHOV, Tihomir a Bengt MUTHÉN. 2010. Bayesian Analysis of Latent Variable Models Using Mplus. Muthén & Muthén. Technical report (www.statmodel.com). Los Angeles, CA.

BENÍTEZ, Isabel, José Luis PADILLA, Fons van de VIJVER a Amaya CUEVAS. 2018. „What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research: An Illustration Using Quality-of-Life Items.“ Field Methods 30(4): 277–294. https://doi.org/10.1177/1525822X18783961

BJØRNSKOV, Christian. 2010. „How Comparable Are the Gallup World Poll Life Satisfaction Data?“ Journal of Happiness Studies 11(1): 41–60. https://doi.org/10.1007/s10902-008-9121-6

BUJACZ, Aleksandra, Joar VITTERSØ, Veronika HUTA a Lukasz D. KACZMAREK. 2014. „Measuring Hedonia and Eudaimonia as Motives for Activities: Cross-National Investigation Through Traditional and Bayesian Structural Equation Modeling.“ Frontiers in Psychology 5: Article 984. https://doi.org/10.3389/fpsyg.2014.00984

BYRNE, Barbara M. 2010. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. Second Edition. New York, NY: Taylor & Francis Group.

BYRNE, Barbara M., Richard J. SHAVELSON a Bengt MUTHÉN. 1989. „Testing for the Equivalence of Factor Covariance and Mean Structures: The Issue of Partial Measurement Invariance.“ Psychological Bulletin 105(3): 456–466. https://doi.org/10.1037/0033-2909.105.3.456

CIECIUCH, Jan a Eldad DAVIDOV. 2012. „A Comparison of the Invariance Properties of the PVQ-40 and the PVQ-21 to Measure Human Values across German and Polish Samples.“ Survey Research Methods 6(1): 37–48.

CIECIUCH, Jan, Eldad DAVIDOV, René ALGESHEIMER a Peter SCHMIDT. 2018. „Testing for Approximate Measurement Invariance of Human Values in the European Social Survey.“ Sociological Methods & Research 47(4): 665–686. https://doi.org/10.1177/0049124117701478

CIECIUCH, Jan, Eldad DAVIDOV, Peter SCHMIDT, René ALGESHEIMER a Shalom H. SCHWARTZ. 2014. „Comparing Results of an Exact vs. an Approximate (Bayesian) Measurement Invariance Test: A Cross-Country Illustration with a Scale to Measure 19 Human Values.“ Frontiers in Psychology 5: Article 982. https://doi.org/10.3389/fpsyg.2014.00982

CUMMINS, Robert A., Richard ECKERSLEY, Julie PALLANT, Jackie van VUGT a RoseAnne MISAJON. 2003. „Developing a National Index of Subjective Wellbeing: The Australian Unity Wellbeing Index.“ Social Indicators Research 64(2): 159–190. https://doi.org/10.1023/A:1024704320683

DAVIDOV, Eldad, Jan CIECIUCH, Bart MEULEMAN, Peter SCHMIDT, René ALGESHEIMER a Mirjam HAUSHERR. 2015. „The Comparability of Measurements of Attitudes toward Immigration in the European Social Survey.“ Public Opinion Quarterly 79(S1): 244–266. https://doi.org/10.1093/poq/nfv008

DAVIDOV, Eldad, Bart MEULEMAN, Jan CIECIUCH, Peter SCHMIDT a Jaak BILLIET. 2014. „Measurement Equivalence in Cross-National Research.“ Annual Review of Sociology 40(1): 55–75. https://doi.org/10.1146/annurev-soc-071913-043137

DAVIDOV, Eldad, Jan CIECIUCH a Peter SCHMIDT. 2018. „The Cross-Country Measurement Comparability in the Immigration Module of the European Social Survey 2014–15.“ Survey Research Methods 12(1): 15–27.

DAVIDOV, Eldad, Peter SCHMIDT a Jaak BILLIET (eds.). 2011. Cross-cultural Analysis: Methods and Applications. New York, NY: Routledge. https://doi.org/10.4324/9780203882924

DEMARS, Christine. 2010. Item Response Theory. Oxford: University Press. https://doi.org/10.1093/acprof:oso/9780195377033.001.0001

DIENER, Ed. 2009. The Science of Well-Being. The Collected Works of Ed Diener. Dordrecht: Springer. https://doi.org/10.1007/978-90-481-2350-6

DIENER, Ed, Robert A. EMMONS, Randy J. LARSEN a Sharon GRIFFIN. 1985. „The Satisfaction With Life Scale.“ Journal of Personality Assessment 49(1): 71–75. https://doi.org/10.1207/s15327752jpa4901_13

DIENER, Ed, Richard E. LUCAS a Shigehiro OISHI. 2018. „Advances and Open Questions in the Science of Subjective Well-Being.“ Collabra: Psychology 4(1): 15. https://doi.org/10.1525/collabra.115

DIENER, Ed, Derrick WIRTZ, Robert BISWAS-DIENER, William TOV, Chu KIM-PRIETO, Dong-won CHOI a Shigehiro OISHI. 2009. „New Measures of Well-Being.“ Pp. 247–266 in Ed DIENER (ed.). Assessing Well-Being. The Collected Works of Ed Diener. Dordrecht: Springer Netherlands. https://doi.org/10.1007/978-90-481-2354-4_12

DIENER, Ed a Richard E. LUCAS. 1999. „Personality and Subjective Well-Being.“ Pp. 213–229 in Daniel KAHNEMAN, Ed DIENER a Norbert SCHWARZ (eds.). Well-Being: The Foundations of Hedonic Psychology. New York: Russell Sage Found.

EMBRETSON, Susan E. a Steven P. REISE. 2000. Item Response Theory for Psychologists. Mahwah, NJ: L. Erlbaum Associates.

EMERSON, Scott D., Martin GUHN a Anne M. GADERMANN. 2017. „Measurement Invariance of the Satisfaction with Life Scale: Reviewing Three Decades of Research.“ Quality of Life Research 26(9): 2251–2264. https://doi.org/10.1007/s11136-017-1552-2

FORS, Filip a Joakim KULIN. 2016. „Bringing Affect Back in: Measuring and Comparing Subjective Well-Being Across Countries.“ Social Indicators Research 127(1): 323–339. https://doi.org/10.1007/s11205-015-0947-0

HUPPERT, Felicia A., Nic MARKS, Andrew CLARK, Johannes SIEGRIST, Alois STUTZER, Joar VITTERSØ a Morten WAHRENDORF. 2009. „Measuring Well-Being Across Europe: Description of the ESS Well-Being Module and Preliminary Findings.“ Social Indicators Research 91(3): 301–315. https://doi.org/10.1007/s11205-008-9346-0

HUPPERT, Felicia A. a Timothy T. C. SO. 2013. „Flourishing Across Europe: Application of a New Conceptual Framework for Defining Well-Being.“ Social Indicators Research 110(3): 837–861. https://doi.org/10.1007/s11205-011-9966-7

CHEN, Fang Fang. 2007. „Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance.“ Structural Equation Modeling: A Multidisciplinary Journal 14(3): 464–504. https://doi.org/10.1080/10705510701301834

JOVANOVIĆ, Veljko, Robert A. CUMMINS, Melissa WEINBERG, Ljiljana KALITERNA a Zvjezdana PRIZMIC-LARSEN. 2019. „Personal Wellbeing Index: A Cross-Cultural Measurement Invariance Study Across Four Countries.“ Journal of Happiness Studies 20(3): 759–775. https://doi.org/10.1007/s10902-018-9966-2

KAHNEMAN, Daniel, Ed DIENER a Norbert SCHWARZ (eds.). 1999. Well-Being: The Foundations of Hedonic Psychology. New York: Russell Sage Found.

KIM, Eun Sook, Chunhua CAO, Yan WANG a Diep T. NGUYEN. 2017. „Measurement Invariance Testing with Many Groups: A Comparison of Five Approaches.“ Structural Equation Modeling: A Multidisciplinary Journal 24(4): 524–544. https://doi.org/10.1080/10705511.2017.1304822

McGILLIVRAY, Mark a Matthew CLARKE. 2006. Understanding Human Well-being. Tokyo: UNU Press. https://doi.org/10.1057/9780230625600

MEITINGER, Katharina. 2017. „Necessary but Insufficient.“ Public Opinion Quarterly 81(2): 447–472. https://doi.org/10.1093/poq/nfx009

MEREDITH, William. 1993. „Measurement Invariance, Factor Analysis and Factorial Invariance.“ Psychometrika 58(4): 525–543. https://doi.org/10.1007/BF02294825

MEULEMAN, Bart, Eldad DAVIDOV a Jaak BILLIET. 2009. „Changing Attitudes toward Immigration in Europe, 2002–2007: A Dynamic Group Conflict Theory Approach.“ Social Science Research 38 (2): 352–365. https://doi.org/10.1016/j.ssresearch.2008.09.006

MÎNDRILĂ, Diana. 2010. „Maximum Likelihood (ML) and Diagonally Weighted Least Squares (DWLS) Estimation Procedures: A Comparison of Estimation Bias with Ordinal and Multivariate Non-Normal Data.“ International Journal of Digital Society 1(1): 60–66. https://doi.org/10.20533/ijds.2040.2570.2010.0010

MONROE, Scott a Li CAI. 2015. „Evaluationg Structural Equation Models for Categorical Outcomes: A New Test Statistic and a Practical Challenge of Interpretation.“ Multivariate Behavioral Research 50(6): 569–583. https://doi.org/10.1080/00273171.2015.1032398

MUTHÉN, Bengt a Tihomir ASPAROUHOV. 2012. „Bayesian Structural Equation Modeling: A More Flexible Representation of Substantive Theory.“ Psychological Methods 17(3): 313–335.https://doi.org/10.1037/a0026802

MUTHÉN, Bengt a Tihomir ASPAROUHOV. 2013. „BSEM Measurement Invariance Analysis.“ Mplus Web Notes 17: 1–48.

MUTHÉN, K. Linda a Bengt O. MUTHÉN. 1998–2017. Mplus User’s Guide (8.). Los Angeles, CA: Muthén & Muthén.

MUTHÉN, Bengt O. 1999. „Fit Indices for Categorical Outcumes.“ Mplus Discussion. 2. listopadu. Cit. 16. srpna 2020 (http://www.statmodel.com/discussion/messages/23/26.html).

NAVRUZ, Bilgin. 2016. „The Behaviors of Robust Weighted Least Squares Estimation Techniques for Categorical/Ordinal Data in Multilevel CFA Models.“ Doctoral dissertation. Texas A & M University.

OECD. 2013. OECD Guidelines on Measuring Subjective Well-Being. OECD.

POKROPEK, Artur, Eldad DAVIDOV a Peter SCHMIDT. 2019. „A Monte Carlo Simulation Study to Assess the Appropriateness of Traditional and Newer Approaches to Test for Measurement Invariance.“ Structural Equation Modeling: A Multidisciplinary Journal 26(5): 724–744. https://doi.org/10.1080/10705511.2018.1561293

POKROPEK, Artur, Peter SCHMIDT a Eldad DAVIDOV. 2020. „Choosing Priors in Bayesian Measurement Invariance Modeling: A Monte Carlo Simulation Study.“ Structural Equation Modeling: A Multidisciplinary Journal online: 1–15. https://doi.org/10.1080/10705511.2019.1703708

RAUDENSKÁ, Petra. 2020. „The Cross-Country and Cross-Time Measurement Invariance of Positive and Negative Affect Scales: Evidence from European Social Survey.“ Social Science Research 86: 102369. https://doi.org/10.1016/j.ssresearch.2019.102369

REEVE, Bryce B. a Peter FAYERS. (2005). „Applying Item Response Theory Modelling for Evaluating Questionnaire Item and Scale Properties.“ Pp. 55–73 in Peter FAYERS a Ron HAYS (eds.). Assessing Quality of Life in Clinical Trials: Methods and Practice, 2nd Edition. Oxford: Oxford University Press.

RUTKOWSKI, Leslie a Dubravka SVETINA. 2014. „Assessing the Hypothesis of Measurement Invariance in the Context of Large-Scale International Surveys.“ Educational and Psychological Measurement 74(1): 31–57. https://doi.org/10.1177/0013164413498257

RUTKOWSKI, Leslie a Dubravka SVETINA. 2017. „Measurement Invariance in International Surveys: Categorical Indicators and Fit Measure Performance.“ Applied Measurement in Education 30(1): 39–51. https://doi.org/10.1080/08957347.2016.1243540

RYAN, Richard M. a Edward L. DECI. 2001. „On Happiness and Human Potentials: A Review of Research on Hedonic and Eudaimonic Well-Being.“ Annual Review of Psychology 52(1): 141–166. https://doi.org/10.1146/annurev.psych.52.1.141

SEDDIG, Daniel a Heinz LEITGÖB. 2018. „Approximate Measurement Invariance and Longitudinal Confirmatory Factor Analysis: Concept and Application with Panel Data.“ Survey Research Methods 12(1): 29–41.

STEENKAMP, Jan‐Benedict E. M. a Hans BAUMGARTNER. 1998. „Assessing Measurement Invariance in Cross‐National Consumer Research.“ Journal of Consumer Research 25(1): 78–107. https://doi.org/10.1086/209528

TAY, Louis, Quiming HUANG a Jeroen K. VERMUNT. 2016. „Item Response Theory With Covariates (IRT-C): Assessing Item Recovery and Differential Item Functioning for the Three-Parameter Logistic Model.“ Educational and Psychological Measurement 76(1): 22–42. https://doi.org/10.1177/0013164415579488

TAY, Louis, Jeroen K. VERMUNT a Chun WANG. 2013. „Assessing the Item Response Theory With Covariate (IRT-C) Procedure for Ascertaining Differential Item Functioning.“ International Journal of Testing 13(3): 201–222. https://doi.org/10.1080/15305058.2012.692415

TERESI, Jeanne A. 2006. „Different Approaches to Differential Item Functioning in Health Applications: Advantages, Disadvantages and Some Neglected Topics.“ Medical Care 44(11): 152–170. https://doi.org/10.1097/01.mlr.0000245142.74628.ab

VAN DE SCHOOT, Rens, Anouck KLUYTMANS, Lars TUMMERS, Peter LUGTIG, Joop HOX a Bengt MUTHÉN. 2013. „Facing Off with Scylla and Charybdis: A Comparison of Scalar, Partial, and the Novel Possibility of Approximate Measurement Invariance.“ Frontiers in Psychology 4: Article 770. https://doi.org/10.3389/fpsyg.2013.00770

VANDENBERG, Robert J. a Charles E. LANCE. 2000. „A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research.“ Organizational Research Methods 3(1): 4–70. https://doi.org/10.1177/109442810031002

WATERMAN, Alan S. 1993. „Two Conceptions of Happiness: Contrasts of Personal Expressiveness (Eudaimonia) and Hedonic Enjoyment.“ Journal of Personality and Social Psychology 64(4): 678–691. https://doi.org/10.1037/0022-3514.64.4.678

WHO. 1998. Wellbeing Measures in Primary Health Care/The Depcare Project. WHO Regional Office for Europe: Copenhagen.

XIA, Yan. 2016. Investigating the Chi-Square-Based Model-Fit Indexes for WLSMV and ULSMV Estimators. Doctoral disseration. Florida State University.

ZERCHER, Florian, Peter SCHMIDT, Jan CIECIUCH a Eldad DAVIDOV. 2015. „The Comparability of the Universalism Value Over Time and Across Countries in the European Social Survey: Exact Vs. Approximate Measurement Invariance.“ Frontiers in Psychology 6: Article 733. https://doi.org/10.3389/fpsyg.2015.00733

ŻEMOJTEL-PIOTROWSKA, Magdalena et al. 2017. „Measurement Invariance of Personal Well-Being Index (PWI-8) Across 26 Countries.“ Journal of Happiness Studies 18(6): 1697–1711. https://doi.org/10.1007/s10902-016-9795-0

Metriky

341

Views

301

PDF views

33

mobi views

27

EPUB views