What algorithm can I use to find correlations between events?

Question

I am new to machine learning so I am trying to find some literature but I'm not even sure what to Google for. My data is of the following form:

User A performs Action P
User B performs Action Q
User C performs Action R
...
User C performs Action X
User A performs Action Y
User B performs Action Z
...

Where each Action has certain characteristics (date, time, client, etc). There are about 300 users and we have about 20,000 actions.

Question:

I want to find out if there is any causality/correlation between user actions. For example, "every time User E performs Action T, 2 days later User G performs Action V". But in between, there could be many other users performing many other actions, and it is possible that there is no correlation to be found. It is also possible that some users are correlated, but others are completely independent. Is this something that machine learning would be able to find for me? Is there a specific algorithm or set of algorithms that could help me?

I have been reading about Association Analysis and the Apriori algorithm but I don't think this will give me what I need, as it seems to require known, well-delimited datasets as input, whereas I just have a long stream of seemingly random user actions. Any suggestions on what to look at would be most appreciated!

Answer 1

I think you've to do some data preparation before using any algorithm to find frequent items set and association rules.

See the transactions table in this article:market basket analysys

In your case you need to set (and fine-tune) a max time span between interaction expected to be correlated, then you can pick a frequent user, and for each transaction he made (or a sample), you'll attach in a single record 2 days of other user transaction. Attributes should be boolean such as

UserA,transactionP |UserB,transaction Z| UserB, transaction F | [...]

Answer 2

One way of exploring your data is to make a table of previous action x next action. So for each event, find the next action by the same user. You could similarly tabulate previous action X delay until next action.

Then you could explore whether the previous action influences the next one. If not, then your users are "stateless".

Another possible simplification is to ignore the userids, and ask whether the frequency of each action is the same over time or varying; and if varying whether it is cyclic or shows a trend.

The answers to these questions might show that your data have little structure. Alternatively, they might raise some new hypotheses to test.

Answer 3

This is an interesting question. The best approach is to look into the entire dataset and create a frequency table. For example: User A is performing Action P and Y User B is performing Action Q and Z, User C performing Action R and X So similarly, there are more users performing more actions. So, there are several approaches to deal with this dataset 1)Cluster algorithm to group similar items in different buckets 2)Market basket analysis to identify the users versus actions mapping and frequency

Without going through the entire data set it is not recommended to prescribe any particular algorithm for these kind of questions.