I am trying to built a classifier for subjective and objective text using imdb data. For objective data point I am using the movie's plot summary as input. For subjective data points I am using reviews of the movie. For example
Objective (plot of Abandon)
Catherine Burke is under pressure. She faces exams, completion of her thesis, and a competitive interview process, all of which is compounded when a police detective, Wade Handler, begins investigating the two year-old disappearance of her boyfriend, Embry Langan, a young man whose memory haunts and obsesses her. As the investigation continues, Catherine is forced to choose between her past passions and new possibilities, even as Handler is discovering surprising new facts about Embry and his possible connection to another disappearance from campus.
Subjective (One of the user reviews)
Caught this on cable last night and I liked it. I thought Katie Holmes did extremely well with a very tricky role, and I thought there were a lot of well written exchanges between the characters, excellent atmospheric touches, and enough psychological ambiguity to allow me to figure out what was really going on before the ending, but this didn't make the film predictable - it made it clever. And the title is a good one - extremely telling, a clue in itself. Of course, it's not a perfect film by any stretch; there's too much stuff that really doesn't need to be in the movie but I still give it a 6 (my IMDb equivalent of *** - a decent premise, decently executed).
I took complete plot summary as one data point where as in case of reviews each review by a single user is a single data point. In my database different reviews of the same movie by different users are entered as different data points.
After this I cleaned the words of special character, removed stop words, calculated the Information gain and applied Naive Bayes to build the classifier.
My questions are:
- Is my algorithm to build the classifier correct?
- My classifer is heavily biased toward classifying text as objective. Am I making mistake in the creation of my training data?
- I want to create a generic classifer that can be used for tweets or
text extracted from blogs. Is movie review data sufficient? Right now it's not working even for movie review data.