# What sort of (supervised?) leaning algorithm should I be using?

I am selecting manually several hundreds Google Alerts (GA) texts those that are indeed relevant for my research vs those which are not (despite they are all triggered by some relevant search keywords).

Basically each week I get several hundreds GA email such as:

and

From such emails I create a file such as:

This is really becoming a time consuming procedure, hence my decision to try applying artificial intelligence solutions to such a case.

What sort of supervised learning algorithm would you advise that I adopt so that it can learn by example from my choices and decide on my behalf whether to retain the piece of information or not - see Retain=Yes/No in the attached file. That is: I can classify a few hundreds cases and then let the algorithm learn and classify future/additional data. I plan to regularly review such a classification, correct missclassifications and train the algorithm again with the objective to improve its ability to correctly classify the GA texts according to the examples I provide the algorithm.

I am also looking for solutions in software. My preferred software is R, but I am also open to other software.

• @Ferdi thanks for the withdraw. For me, I got a lot of help from people in CV, and want to help more people. I think the worst question is pasting homework or show no thinking but expect other people to do the work. Any questions shows the thought process are not bad in my view. – Haitao Du Oct 2 '17 at 18:04

First, I think supervised learning may not good for what you want to do, because of limited data.

I can classify a few hundreds cases and then let the algorithm learn and classify future/additional data.

Few hundreds is very likely to be too few to build a system has reasonable performance. For example, this spam data set in UCI has ~ 4600 examples.

From what you described, a rule based system may work better. You may try to summarize some logics you used to classify if an alert is retained or not. With limited data, a rule based system usually would work better.

If you want to use supervised learning:

You are missing a crucial step for supervised learning: feature extraction. The data you presented is very raw. How can we feed a model with such data? are we feeding in plan text or something else?

If you can write same parser to extract useful information, such as alert time, alert title etc, that would be better than plan text file. With extracted features, almost all the supervised learning algorithm can be used.

Take a look at the SPAM data set I linked above, there are $57$ features people derived. Deriving these features is your missing step.

• Thank you for your answer. Actually I said a few hundreds but probably I am looking more into the thousands so the data scarsity might not be an issue here. What I am more concerned about is that I am trying to build a flexible system whereby I can work on multiple languages and multiple subjects and continuously improve its performances - i.e. the % correct classified items - because of historical data. Please notice than in one year I classify approximately 5-6 k items out of a pool of 5 to 10 times more items. – Luca Oct 3 '17 at 8:34
• For what feature extraction is concerned can't the system/algorithm automatically provide for that? My decision rule are generally based on a combination of link/title, source and brief text. Is there a convenient software/solution that can (a) take the GA html files from a folder and organise a proper dataset and (b) run some supervised net so that if can mimic the decision made in the training set? – Luca Oct 3 '17 at 8:38