Background: I do survey research on Information Systems. I have a latent construct that I measure with six survey items and reflective measurement model. Each survey item has a seven point Likert scale. This construct and these items are embedded in a larger structural equation model (SEM). I’m wondering about assessing the output of PLS-SEM estimation. Literature suggests various criteria. I’m specifically wondering about internal consistency reliability (ICR) as measured by Cronbach’s alpha and convergent validity as measured by average variance extracted. I’m confused by how their interpretation differs.
As I understand it
- ICR is a measure based on the correlations between different items. It is commonly assessed by Cronbach’s alpha. Cronbach’s alpha can be written as a function of the number of survey items and the average inter-correlation among these items. In my example, alpha is well above the conventional threshold of 0.7. Con
- Convergent validity refers to the degree to which a measure is correlated with other measures that it is theoretically predicted to correlate with. Average variance extracted (AVE) is commonly used to assess convergent validity. To calculate AVE of my latent construct, I take the loadings of the six items on the construct and calculate the average of squared loadings. In my example, AVE is well below the conventional threshold of 0.5.
My questions are
- To me, AVE and alpha appear rather related. If each item by itself is a good measure for the latent construct, all items will load highly on the construct (i.e. high AVE) and all items will correlate with each other (i.e. high alpha). How come to rather related statistics can be used to assess bot reliability and validity?
- In my example, I have alpha > 0.7 (i.e. internal consistency is ok), AVE < 0.5 (i.e. lack of convergent validity) but AVE greater than squared inter-construct correlations (i.e. discriminant validity is ok). How to interpret this situation?
Side remarks
- I know that for assessing discriminant validity, AVE is commonly compared to squared inter-construct correlations.
- I read a few times (but did not understand) that high values for alpha do not imply unidimensionality. However, given that to me unidimensionality is different from both reliability and validity, I don’t know how this would solve my question.