I am learning individual differences scaling (AKA three-way multidimensional scaling) and I want to know what different ways there are to state that my results are reliable.
I had to perform individual differences scaling in 2 dimensions on the data, and give the group object space. I work in
R, with the
smacof package (this is obligatory). So far I am ok. But this is an additional question:
It is recommended to supplement the analysis with additional investigations before placing too much belief in its results. List 3 investigations that you would undertake and explain the reasons for performing these analyses.
The answer I can think of:
1) Check the overall stress of the model against a similar model with random data. If the stress levels are not significantly lower, you probably got a configuration that is based on coincidence.
2) Try the model with more and less dimensionalities, and look at the scree plot of the stress levels. This can tell you if choosing a 2-dimensional solution was the best decision.
3) Check the individual configurations, to see whether some persons used different criteria than others. Then it would be better to look at the individual pictures, instead of the group object space.
Could anyone give any feedback on this answer? I can't seem to find much info anywhere else.