When we are done in pre-processing the text (removing stop words, stemming, lower case) then creating a term document that has TF-IDF as weight.
How can I decide what correlation test to do between my terms and the target variable?? I want to know what terms are affecting my target. My target variable is continuous from 1 to 100.
For example, when I used Pearson correlation it did not making sense to me as I am not sure what is an increase or a decrease for a word used.
Edit: I did a scatter plot for the function score and TF-IDF for the term "word". Since the TF-IDF is sparse and has alot of zeros , the plot didnt seem to be linear or make sense... how can I proceed if I want to find the correlation ?