Questions tagged [sentiment-analysis]

The tag has no usage guidance.

0
votes
0answers
6 views

Endogeneity bias

For my dissertation, I am trying to determine whether chosen 'sentiment measure' have predictive power for stock returns(S&P 500). These sentiment measures consists of LN VIX for example ( change ...
0
votes
0answers
17 views

binary classification problem for data where one class potentially includes members of the other class

Situation Assuming one wants to classify text data into two sentiment categories: negative and neutral (i.e everything that is not negative). For the training process, labelled data is available. ...
1
vote
0answers
16 views

Correlation between sentiment opinions of articles and sentiment of tweets. Comment on appropriate method [closed]

I want to measure a set of hashtags on twitter, and see if peoples sentiment on a set of hashtags is affected by the sentiment of newspaper articles that they retweet. What would be the best way to ...
0
votes
0answers
25 views

Similarity of form of two curves

Currently I'm working on a project on finding out the similarity of two movies based on the sentiment analysis I did on their subtitles. I measured the sentiment of each individual sentence and paired ...
0
votes
0answers
4 views

Aggregate Sentiment and Behaviour Index

I have data of sentiment and behavior based signals for certain stocks. They are based on positive, negative words in a document. How can I aggregate(like an index) those individual signals to ...
0
votes
0answers
16 views

How should I understand a Self-Organizing Fuzzy Neural Network?

I'm currently doing research to write a paper for a conference submission (undergraduate-level) and had a question regarding the research I've been conducting. My topic is on using Twitter sentiment ...
0
votes
0answers
27 views

Sentiment Analysis Issues Using R

I am using the R package sentimentr and sentiment function to get polarity/sentiment scores on a list of comments. The issue I am having is that the comments are in ...
2
votes
1answer
42 views

Word Embedding for Sentiment Analysis

I am working on sentiment analysis of text. I am using keras word embedding. If my embedding has a vocabulary of 50 and an input length of 4 and I choose an embedding space of 8 dimensions, how will ...
0
votes
0answers
21 views

How to compare two sets of time dependent proportions?

I am doing a sentiment analysis task about the people's attitudes towards transportation services in Hong Kong. I collected Tweets near the railway stations and see if there is any difference between ...
0
votes
0answers
19 views

Required sample size for sentiment analysis in customer satisfaction

Suppose we are interested in seeing how companies A through F are being viewed by different customers, and how this changes based on the customers' positions. A sample of customers is drawn from ...
0
votes
0answers
26 views

Using LDA on sentences of speeches

I can not find a thread or question on the internet which matches my particular case. I want to know whether my approach is fine. I want to compare the sentiment (tone) of particular topics in ...
0
votes
0answers
30 views

State of the art in feature extraction from review text

I am working on a sentiment review classification problem and so far i have explored POS tags, synsets, N-grams, word2vec, tf-idf, doc2vec, glove and fastext vectors as features. I am wondering what ...
1
vote
0answers
41 views

Deep Learning sentiment analysis model always predicts same class [closed]

I'd really appreciate your help as I'm not an expert in Deep Learning for sentiment analysis and I'm a bit lost. I'm using the Sentiment140 dataset: http://help.sentiment140.com/for-students First ...
0
votes
0answers
76 views

How do I normalize or weight document-feature-matrix by length of dictionary entries

What is the best practice way to normalize or weight document-feature-matrices by the length of dictionary entries. Here is some sample code. In reality, my example works with different issues e.g. ...
1
vote
0answers
86 views

Sentiment analysis probabilities

I'm looking into a Kaggle dataset of news article with three columns for the results of sentiment analysis for news items, each about a different company. The columns present the results of ...
1
vote
1answer
26 views

Getting ValueError while implementing LSTM in keras

I am getting this error while implementing LSTM in Keras: """"Error when checking input: expected lstm_16_input to have 3 dimensions, but got array with shape (156060, 1)"""" I have 156060 text ...
0
votes
2answers
51 views

Can sentiment “analysis” be called sentiment “recognition”? [closed]

In sentiment analysis application of NLP, we are basically required to predict an emotion given a piece of text. Can we say that we are doing "sentiment recognition" instead of "sentiment analysis" ?...
0
votes
1answer
84 views

Preparing test data for sentiment analysis in Tensor Flow

1) I want to do Sentiment Analysis using RNN + Tensor Flow + (Keras) 2) Is it necessary to prepare test data for sentiment analysis, using RNN, (or any Neural Network), in a certain format ? If so is ...
0
votes
0answers
20 views

Sentiment analysis on IMDB database and choose of metric [duplicate]

I am currently working on an extract of the IMDB available on http://ai.stanford.edu/~amaas/data/sentiment/ . Since i try to predict the label (between 1 and 10) related with each review i face a ...
0
votes
1answer
24 views

Text classification - regularization worsens validation score

I have the text classification problem. Dataset is imbalanced in terms of classes. I'm using StratifiedKFold and balanced weights updating during training LogisticRegression. Let's say my score is: ...
1
vote
0answers
26 views

Machine Learning in human behavior studies [closed]

Let's say we are trying to figure out whether a president of a country will take a step backward or forward related to a topic. We want to classify this by training a learning algorithm on Twitter ...
3
votes
0answers
234 views

Delta TF-IDF right choice for multi classification problem

In the paper of Martineau & Finin they describe their new approach with Delta TF-IDF . Instead of measuring how rare features are in the document, they weight these values by how biased they are ...
0
votes
0answers
24 views

How do you use classification algorithms in a sentiment analysis?

Classification algorithms (logistic regression, SVM, etc) work on $(x, y)$ data where $y$ is a categorical (often binary) response and $x$ is a multi-variate predictor. How are these algorithms ...
0
votes
0answers
516 views

Sklearn logistic regression top coefficients meaning for sentiment analysis

I have a term document matrix, where each element represents the tf-idf value for the given term and document. There are 5000 features (terms) as columns which represents the top 5000 words, and each ...
0
votes
0answers
841 views

Sentiment Analysis using NRC emotion lexicon/EmoLex

I am trying to perform sentiment analysis on few tweets. I have come across NRC emotion lexicon (http://jonathansoma.com/lede/algorithms-2017/classes/more-text-analysis/nrc-emotional-lexicon/) and was ...
1
vote
0answers
28 views

facebook analysis using r [closed]

I am trying to fletch the information about user who comments on facebook post using getUsers(user_id,token=token1,private_info = T,api ="v1.0") but it does not give me gender,location and ...
1
vote
0answers
214 views

Low score in sentiment analysis : how to increase it and maybe deal with class imbalance

It has been 2 weeks now I am working on SemEval task 4 (2016) : Sentiment Analysis on Twitter. The results I achieve are lower than what I expected for the three class classification problem : ...
1
vote
0answers
241 views

How much data is needed for transfer learning?

I have a pre-trained sentiment classifier on Amazon reviews and I want to use it for transfer learning to classify sentiments on a specific aspect of some products, for example how a person feels ...
-1
votes
1answer
1k views

How can you apply sentiment analysis on topic modelling topics?

I need to perform sentiment analysis on topic modelling. I have used LDA with grid search search to identify the topic. The next step would be to perform sentiment analysis on it. How should I go ...
0
votes
1answer
27 views

Sentiment analysis, are my samples significantly different?

I have extracted data from a reviews website. I have created a dictionary with all words that appear in the reviews and corresponding number of counts. I have then spit the reviews into two samples: ...
0
votes
1answer
739 views

Train a model Sentiment Analysis scikit learn

I am getting started with NLP and Sentiment Analysis. I would like to train a model with Scikit-Learn for detecting the sentiment of tweets. I have a labeled dataset of tweets, how should I train a ...
0
votes
0answers
313 views

Sentiment Analysis - Emoticon

I am working on an NLP project, my objective is to compute a Sentiment Analysis over short text message. So far, I did not come up with a solution to account the emoticons. I want to use a machine ...
0
votes
1answer
609 views

Use of shuffled dataset for training and validating lstm recurrent neural network models

I am trying to build a recurrent neural net model using lstm trying to predict future outputs from a financial time series. Outputs are classified in macro classes according to the magnitude of ...
0
votes
0answers
60 views

How can I classify my text by using unsupervised approaches?

I have a corpus of newspaper articles and would like to classify them according to content (words, phrases) that I determine beforehand. The only way to do this that I found so far is by looking at ...
3
votes
0answers
285 views

Why does RNN overfit for sentiment analysis but not for spam detection?

I used this code which uses RNNs for spam detection and got reasonable results. But when I use the same code for sentiment analysis, the model overfits badly: its training accuracy keep growing, but ...
1
vote
0answers
25 views

Aggregate previously classified items taking into account precision&recall

I have a set of messages classified in k categories using sentiment analysis. I have also the precision, recall and accuracy of the classification technique for each category. Now I would like to ...
1
vote
0answers
26 views

adding frequency of features give better results

I have a binary feature that i want to use it with textual features i.e. one grams. I use logistic regression and TF/IDF for representing text. So i simply add a unique feature, say ss or oo, to text ...
0
votes
0answers
511 views

How to improve twitter LSTM NN sentiment analysis

I am trying to build an LSTM neural network to do sentiment analysis on twitter feeds. The dataset I use contains ~1.5M twitter feeds with either positive or negative sentiment (the tweets were ranked ...
1
vote
2answers
437 views

Sentiment analysis resources

I need to do a complete presentation about sentiment analysis with its definition, methods, applications and so on. I would be delighted if you could tell me some resource: links, books, videos, etc....
1
vote
1answer
2k views

Sentiment Analysis Dictionaries - positive, negative, neutral

I would like to classify user comments in reply to articles on news portals, especially in my country. Many comments are tweet-like in length but others can be quite long (a few hundred words). I ...
0
votes
1answer
124 views

sentiment analysis with ranking scale

I have a Customer feedback about quality of service of a bank. I have data Excel format : header row contains the question ans the row below contains the response of the Customer. The responses can be ...
0
votes
1answer
287 views

How can these filters be found for such a convolutional neural network?

In the paper UNITN: Training Deep Convolutional Neural Network for Twitter Sentiment Classification, as the name suggests, a CNN architecture for sentiment classification is being introduced: I am ...
1
vote
1answer
513 views

Sentiment Analysis- Airbnb [closed]

Are there specific packages in R to do sentiment analysis? I have public reviews of airbnb Seattle here (http://insideairbnb.com/get-the-data.html) and I am intersted in seeing the positive, negative ...
3
votes
0answers
103 views

Machine learning basic learning question

I have been studying machine learning on my own, from online videos and tutorials and by referring books from the library. I am finding it very difficult to understand the concepts. I am not speaking ...
0
votes
1answer
164 views

Sentiment analysis for a data

I have a dataframe in which every row is a text in which I would like to implement sentiment analysis with positive or negative results. I made the appropriate cleaning to the text removing the ...
1
vote
0answers
23 views

A sample of event attendees take both a pre and post event sentiment survey, how do I compare answers with population?

I am measuring the net change in opinion after an event. For example, if this is the question "This university is a leader in academic research" then the available answers are "1) Completely disagree, ...
2
votes
0answers
888 views

Effect of stop words in sentiment analysis

I'm using Naive Bayes algorithm to classify movie reviews (positive and negative). I tried to eliminate stop words (by a stop words list) before running the algorithm then I realized it led to a worse ...
1
vote
1answer
2k views

Word Vectors in Word2Vec

I am trying to do sentiment analysis. In order to convert the words to word vectors I am using word2vec model from gensim package. Suppose I have all the sentences in a list named 'sentences' and I am ...
1
vote
2answers
974 views

Word vectors as input in Keras

I have a corpus on which I want to perform sentiment analysis using LSTM and word embeddings. I have converted the words in the documents to word vectors using word2vec. My question is how to input ...
5
votes
2answers
811 views

Financial Slang and NLP for Sentiment Analysis

I am working on Sentiment-Analysis/Opinion-Mining of Tweets, focused on Finance related tweets. One of the biggest issues I am facing is the unability of my algorithm to detect equivalent entities (...