While testing some software I had users fill up a survey which asks questions in Likert scale type item(1-5) about the 3 different states of the software. These states were: one without aid, one with aid in a particular format and one with aid in another format. This was conducted on the same group of individuals in a "try this, then this, then this, now answer the survey" format.
The survey consisted of 20 questions each of which were independent variables. How do I go about analysing this data? While searching for answers I noticed some persons saying that I can just represent this data using bar charts to get the point across but I have doubts about this.
The software itself also collected information on the performance of users for a more objective approach. However this data is formatted into 3 groups. I originally thought about using a paired sample t-test to compare it with the following:
- Without aid - Aid with 1 format
- Without aid - Aid with the 2nd format
- Aid with 1 format - Aid with the 2nd format
in order to determine if there was a significant difference. Would this t test be valid for comparisons like this in this scenario? Is there another option?
This is an example of the data where the values are scores for each format:
| Without aid | Aid(format 1) | Aid(format 2) |
|---|---|---|
| 5 | 6 | 7 |
Finally would you advise attempting to apply analysis to both the qualitative (likert) and quantiative data in order to link the two? Like for example Spearmans correlation. If yes what in particular would you suggest?
P.S: I'm a bit new to statistical analysis so I'm still learning about various tests.
The goal is to test a hypothesis that the inclusion of these formats do help the user.