An Alternative Estimate of Reliability for Test-Retest Data

再測資料之信度估計式

10.6504/JOM.2010.27.04.03

丁承(Cherng G. Ding)；鄭天德(Ten-Der Jane)

驗證性因素分析 ； 探索性因素分析 ； 記憶效果 ； 信度 ； 再測相關係數 ； Confirmatory Factor Analysis CFA ； Exploratory Factor Analysis EFA ； Memory Effects ； Reliabilitry ； Test-Retest Correlation

管理學報

27卷4期（2010 / 08 / 01）

355 - 369

英文

本研究針對同類問項之再測資料，提出一無需使用驗證性因素分析之信度估計式，該式係再測相關係數之記憶效果校正式，不會受困於估計問題。蒙地卡羅模擬結果顯示，無論是常態或非常態資料，當驗證性因素分析無估計問題存在時，在大樣本下，所提信度估計式與利用驗證性因素分析之既有信度估計式表現相當，而在較小樣本下，該估計式之表現較優。該估計式於再測資料之信度評估上具參考價值。

In this research, an alternative estimate of reliability for test-retest data with congeneric items is proposed without confirmatory factor analysis (CFA). It is the sample test-retest correlation corrected for estimated memory effects, and involves no estimation problems. Monte Carlo simulation results have indicated that, no matter for normal or non-normal data, when there exist no estimation problems in CFA, the proposed estimate performs as well as the existing estimate resulting from CFA for large samples, and better for smaller samples. It is useful or assessing reliability of scale scores in test-retest designs.

1. Anderson, James C.,Gerbing, David W.(1988).Structural Equation Modeling in Practice: A Review and Recommended Two-Step Approach.Psychological Bulletin,103(3),411-423.
2. Browne, M. W.(1984).Asymptotically Distribution-Free Methods for the Analysis of Covariance Structures.British Journal of Mathematical and Statistical Psychology,37(1),62-83.
3. Chen, Feinian,Bollen, Kenneth A.,Paxton, Pamela,Curran, Patrick J.,Kirby, James B.(2001).Improper Solutions in Structural Equation Models: Causes, Consequences, and Strategies.Sociological Methods & Research,29(4),468-508.
4. Cronbach, Lee J.(1951).Coefficient Alpha and the Internal Structure of Tests.Psychometrika,16(3),297-334.
5. Fan, Xitao,Felsovalyi, Akos,Sivo, Stephen A.,Keenan, Sean C.(2002).SAS for Monte Carlo Studies: A Guide for Quantitative Researchers.Cary, NC:SAS Institute.
6. Fleishman, Allen I.(1978).A Method for Simulating Non-Normal Distributions.Psychometrika,43(4),521-532.
7. Green, Samuel B.(2003).A Coefficient Alpha for Test-Retest Data.Psychological Methods,8(1),88-101.
8. Hair, Joseph F.,Black, Bill,Babin, Barry,Anderson, Rolph E.,Tatham, Ronald L.(2006).Multivariate Data Analysis 6th ed..NJ:Pearson Prentice Hall.
9. Henze, N.,Zirkler, B.(1990).A Class of Invariant Consistent Tests for Multivariate Normality.Communications in Statistics-Theory and Methods,19(10),3595-3617.
10. Jaccard, James,Wan, Choi K.(1995).Measurement Error in the Analysis of Interaction Effects between Continuous Predictors Using Multiple Regression: Multiple Indicator and Structural Equation Approaches.Psychological Bulletin,117(2),348-357.
11. Komaroff, Eugene(1997).Effect of Simultaneous Violations of Essential τ-Equivalence and Uncorrelated Error on Coefficient α.Applied Psychological Measurement,21(4),337-348.
12. Lucke, Joseph F.(2005).The α and the ω of Congeneric Test Theory: An Extension of Reliability and Internal Consistency to Heterogeneous Tests.Applied Psychological Measurement,29(1),65-81.
13. Osburn, H. G.(2000).Coefficient Alpha and Related Internal Consistency Reliability Coefficients.Psychological Methods,5(3),343-355.
14. Raykov, Tenko(1998).Coefficient Alpha and Composite Reliability with Interrelated Nonhomogeneous Items.Applied Psychological Measurement,22(4),375-385.
15. Raykov, Tenko(1997).Scale Reliability, Cronbach's Coefficient Alpha, and Violations of Essential Tau-Equivalence with Fixed Congeneric Components.Multivariate Behavioral Research,32(4),329-353.
16. Raykov, Tenko,Penev, Spiridon(2005).Estimation of Reliability for Multiple-Component Measuring Instruments in Test-Retest Designs.British Journal of Mathematical and Statistical Psychology,58(2),285-299.
17. Schmidt, Frank L.,Hunter, John E.(1999).Theory Testing and Measurement Error.Intelligence,27(3),183-198.
18. Stanton, Annette L.,Kirk, Sarah B.,Cameron, Christine L.,Danoff-Burg, Sharon(2000).Coping through Emotional Approach: Scale Construction and Validation.Journal of Personality and Social Psychology,78(6),1150-1169.