In machine learning for text classification, the first step after acquiring and cleaning the data is that of feature extraction. Since computers can't understand language like humans, the language needs to be converted to a vector representation.
I'm building machine classification models on medium size dataset ~ 10k rows. One of the things with machine learning is feature extraction and the better it is the better the classifier has information and the better it performs at the task.
The common way of converting a text to a vector that I know of are:
- POS tags
- Word Embeddings (although I tend to avoid since it's trained on Google news articles and not totally works in all cases. I created my own embedding)
I am trying to find research papers that talk about more recent ways/ other ways of extracting meaningful vector representation from text. If someone knows, please share.