體驗區
|
| 篇名 |
雙因素模型下測驗分數信度係數之比較
|
| 並列篇名 |
A Comparison of Reliability Coefficients for Test Scores Under Bi-factor Models
|
| 作者 |
鄧祈允(Chi-Yun Deng)
、黃柏僩(Po-Hsien Huang)
|
| 中文摘要 |
在估計測驗分數的信度時，應先考慮測驗的向度（dimensionality），若測驗結構為多向度時，則應使用多向度信度估計法，常見的方法包括分層α、Revelle的β、多向度ω，以及階層ω。然而，過往研究並未仔細檢驗前述多向度估計法的差異，故本研究在真實模型為雙因素模型（bi-factor model）的假設下，系統性地操弄一般因素負荷量、子因素負荷量、子因素數目，以及樣本數，以探討前述四種信度估計法之表現。當以各信度係數之母體參數作為真實數值時，模擬研究結果顯示僅在子因素負荷量較高時，階層才會與另外三個信度係數有明顯不一致之真實數值，此意味著在子因素負荷量的真實數值較小時，分層α、β、多向度ω所得到的測驗分數信度估計值仍具有相當高之參考性，其中β的與階層ω展現最為一致之真實數值。當比較各方法的估計表現時，結果顯示相較於多向度ω、分層α，以及β，階層ω橫跨所有情境都展現較大的相對偏誤（relative bias）與變異性（variability），此顯示階層ω雖在估計概念較為合理，但於有限樣本之實徵表現不佳。本研究結果建議，在估計多向度測驗分數的信度時，不應僅參考階層ω，仍需使用其他多向度信度估計指標做為輔助，以對測驗分數的信度有較佳的估計與詮釋。
|
| 英文摘要 |
When estimating a test score’s reliability, the dimensionality of the test needs to be considered. If the test is not unidimensional, multidimensional reliability coefficients, such as stratified alpha, Revelle’s beta, multidimensional omega, and hierarchical omega, should be used. However, these multidimensional coefficients might not be carefully distinguished in practical works. This study aimed to investigate these coefficients’ meanings and properties. We used bi-factor models as true models for data generation and manipulated loadings of general and group factors, numbers of group factors, and sample sizes. The results showed that: (1) the true value of hierarchical omega was significantly different from other coefficients only when group factor loadings were high; (2) the true value of Revelle’s beta was most similar to the hierarchical omega; (3) hierarchical omega yielded larger relative bias and variability than other coefficients under all conditions. These results implied other multidimensional reliability coefficients were still valuable when group factor loadings were low and hierarchical omega didn’t perform well under finite sample settings, although hierarchical omega’s meaning was most interpretable. These results suggested hierarchical omega should not be considered as "golden standard", other coefficients were still useful to interpret measurement results.
|
| 頁次 |
209-231
|
| 關鍵詞 |
Revelle的β
、分層α
、多向度ω
、信度
、階層ω
、雙因素模型
、bi-factor model
、hieratical omega
、multidimensional omega
、reliability
、Revelle’s beta
、stratified alpha
、TSSCI
|
| 卷期 |
68:3
|
| 日期 |
202109
|
| 刊名 |
測驗學刊
|
| 出版單位 |
中國測驗學會、心理出版社
|
|
相關文獻 :
客服信箱