Questions tagged [association-rules]
The association-rules tag has no usage guidance.
106
questions
0
votes
0
answers
16
views
Confidence vs order in data mining
Is there the relation between confidence and order of association rule when I am applying Apriori algorithm? Or is it dependent on the dataset?
Disclaimer: This is based on a homework question. The ...
- 101
0
votes
0
answers
9
views
What is a suitable technique to obtain time-related behavioral information from a data set?
I have a data set similar to the following, that describes the number of items 2 machines produce in 15 minute time slots on a given day (e.g., Monday):
Assume that the same behavior is repeated on ...
- 33
0
votes
0
answers
16
views
What statistical methods can I use to determine the popularity of item combinations taken from two groups?
Let's say I have two tables, listing projects with the programming languages and frameworks they use:
...
- 1
0
votes
0
answers
9
views
Association rules - Single item transactions
I am currently handling a dataset which involves customers' purchase history data.
our data consists of columns like purchase_date, item_id, trasaction_id, volume, price etc
However, I see that most ...
- 2,894
1
vote
2
answers
188
views
Market Basket Analysis - Interpretation of mirrored association rules
I have performed Market Basket Analysis on sales data, that comes from non-sequential receipts. I've read into the meaning of the different metrics, but there is one thing I don't understand. When ...
- 65
2
votes
0
answers
18
views
Is there any relationship between confidence ratio in association rule and Bayesian rule?
I am currently studying Association Rule and somehow I thought about if there is any relationship between confidence ratio in Association Rule and Bayesian Rule. My knowledge in Bayesian Rule is not ...
- 3,145
0
votes
1
answer
298
views
Is lift for Association Rules the same in both direction?
I am just discovering Association Rules, but am a little confused, particularly with the interpretation of the results. My main question is - is the Lift for two items always the same in both ...
- 1
0
votes
1
answer
58
views
Streamlining / Optimizing conditional Rules in a rule engine using ML techniques
The problem is defined as follows :
We are dealing with a Rule engine used to classify a credit risk as 'Good', 'Medium' or 'bad'. Say the rule engine which has say 10 rules. These rules are ...
- 315
0
votes
0
answers
90
views
Product cannibalization - Would affinity analysis help?
We send an email to our customers to advertise 3-4 products every day.
Supposing that today's email is advertising three products (product A, product B, product C), the customer is given four options:
...
1
vote
1
answer
137
views
What is the threshold for "frequent" in the Apriori algorithm?
I'm reading about the Apriori algorithm using the textbook Introduction to Machine Learning (Ethem Alpaydin) and had a question.
I've noticed that the textbook and many other resources I find online ...
- 3,346
2
votes
1
answer
167
views
Makes sense to do a Market Basket Analysis with transactions grouped by month (or week)?
Most of the articles on the internet shows the Market Basket Analysis using data from supermarket (i.e. clients uses to buy a lot of items in one day in a supermarket), so I think makes sense to group ...
- 363
1
vote
1
answer
27
views
Need some help simplifying an expression
The expression is:
$=\sum_{i=1}^{M}[(\frac{1}{L})^N\frac{1}{M+1}] $
user292800
1
vote
0
answers
22
views
How to encode categorical data when 1+ categories are more relevant than others?
Suppose to have a questionnaire that asks 2 questions:
"What is your top 3 favorite food?"
"What drink do you like?"
I need to find association between the 1st answer given and ...
- 143
0
votes
1
answer
86
views
Association rules for congressional votes with missing values
Using the UCI dataset here: http://archive.ics.uci.edu/ml/datasets/Congressional+Voting+Records
Each congressperson votes yay, nay or present (basically abstains) on 16 issues.
My teacher wants us to ...
- 125
2
votes
1
answer
77
views
Using scatterplot before running a controlled experiment to test causality
This question is an extension of awesome thread Does causation imply correlation?.
As an example, let's say that I am running an online experiment on Stackoverflow to see whether asking more ...
- 233
1
vote
0
answers
101
views
Clustering binary data : feature selection vs Apriori
My data set is a 999 rows x 964 columns Panda DataFrame.
Each row is a user.
My data is binary : 0 for absent and 1 for present.
I would like to fit the users ...
- 11
1
vote
1
answer
62
views
can computers play word association games?
Suppose I give you these 6 English words:
circle, low, Brian, sentence, support, wild
and ask you to find a 7th word that is associated with all of them. You probably already know which one it is.
...
- 569
0
votes
0
answers
53
views
Interpreting association rules
I'm using mlxtend to find association rules in a dataset of products that customer bought over the span of a month. You can see an example of how it is used here.
The dataset has around 1000 types of ...
- 215
1
vote
0
answers
61
views
Are there any assumptions about row/column margins in a chi2 test?
I just learned that most tests of associations on 2x2 tables have assumptions about row and column margins being fixed or not.
Is there any similar assumption when it comes to chi2 tests? Can I do ...
- 125
1
vote
2
answers
1k
views
How to binarize data for FP Growth in Weka?
I have a CSV file where all comlumns contains numerical values except for the quality column which contains nominal values. I want to use FP Growth Weka algorithm ...
- 83
0
votes
1
answer
185
views
Association rule lift ratio converging to 0.5, is it not independent?
As far as I know, lift is a measure used in association rules to see whether there is a positive association between two items(instances?)
I've done a simple (possibly wrong) simulation with lift ...
- 5
0
votes
1
answer
47
views
Indirect clustering / association finding
I'm looking for recommendations of techniques that allow me to cluster or find associated items, through an indirect layer.
Imagine a hypothetical database of information about patients, including ...
2
votes
1
answer
45
views
Test if P(A) and P(A|b) are statistically different
I am using Apriori to find association rules, where each instance is a vector of True/False value, indicating whether an item is bought or not. Suppose that we obtain a rule b=>a with confidence c, ...
- 21
1
vote
1
answer
106
views
In association rule mining, is it okay to disregard single item purchases?
I'm doing a market basket analysis of items purchases in particular stores. Each dataset contains over 5 million transactions. I'm currently processing this in R, but it seems my computer can't handle ...
- 729
2
votes
1
answer
196
views
Which is the state of the art regarding methods for Association rule learning?
I have a set of data about which I would like as a first step, discover some interesting or frequent relationships. For this I know that there are several algorithms, like association or sequence ...
- 231
1
vote
0
answers
560
views
Association rules between many continuous variables
I have a large dataset and I'm trying to mining association rules between the variables.
My problem is that I have 160 variables among which I have to look for the association rules and also I have ...
- 111
1
vote
2
answers
56
views
Rule between Inputs and Outputs
I have a set of 5 binary inputs and for each there are a set of 5 binary outputs.
I would like to know what technique one could use to find the rule between them..? I've used Machine Learning in then ...
- 825
4
votes
0
answers
4k
views
Intuitive meaning behind support, confidence, lift and conviction
I'm learning about association rules and came across the common interestingness measures support, confidence, lift and conviction.
I'm interested in the intuition behind your decision-making process ...
- 161
2
votes
1
answer
1k
views
Association Rules by Apriori Algorithm - How to read them?
Let's consider mining of the association rules for basket analysis at a petrol station.
It is obvious that most people buy petrol, some of them something extra.
The following implications are valid:
...
- 2,698
2
votes
0
answers
310
views
What do Association Rules add beyond "standard" conditional probability?
I'm hoping that people will indulge me a beginner question, but I was recently learning about association rule learning from a lecture on Information Retrieval. (For reference, the video I was ...
2
votes
1
answer
456
views
How to check cross validation scores for market basket analysis?
If I have a large set of transactions where in each I buy a set of goods and I want to do market basket analysis using either A-priori or FP Growth or any other data mining method, you typically get ...
3
votes
1
answer
2k
views
What is the confidence for rule for $\emptyset \implies A $?
I'm looking at a question for association rule mining and this comes up:
What is the confidence for $\emptyset \implies A $?
What is the confidence for $ A \implies \emptyset $?
Given:
$$\...
- 133
0
votes
2
answers
90
views
Basic combinatorics for rule learning
This is supposed to be a rather rudimentary combinatorics problem, however, I can't seem to wrap my head around it.
The Problem
There are 40 distinct items, one person can pick (up to) 3 items. To ...
1
vote
1
answer
2k
views
R Arules Market Basket Analysis Redundant Rules Approaches [closed]
Using R and arules. I see several opinions on how to remove redundant rules which give different answers.
If this is my example dataset:
...
- 335
1
vote
0
answers
55
views
Can inferencing come from incomplete rule sets?
I have some data for medical diagnosis, consisting of some rules about relationship of diseases and their symptoms, for example disease D1 frequently has symptom S1 ...
- 91
0
votes
1
answer
311
views
Interest measure for frequent itemsets in databases of different size
Consider a market basket analysis:
Among a certain number of transactions two items sometimes occur together. For simplicity let's assume they always occur together, but not in all transactions.
Now ...
2
votes
0
answers
230
views
Covariates in a case control study
I am doing a retrospective analysis on a study has has cases and controls. I am looking to see if there is an association with death, using exact logistic regression. I am confused on whether I need ...
- 209
0
votes
1
answer
2k
views
How does term association work in text mining
Before performing word association, we create a term document matrix after removing punctuations, capitals, etc. How does the association algorithm work? Since we have removed the markers to identify ...
- 113
2
votes
1
answer
640
views
Why are all my lift values the same?
I'm trying to measure association in my basket based on transactions. Let's imagine I have 5 products. Then, I calculate the number of client who bought product A and B, A and C, B and C and so on.
...
- 21
0
votes
1
answer
1k
views
Weka PART algorithm output
I am using Weka PART on my data set, and it is providing the rules below:
...
- 1
3
votes
1
answer
531
views
Need explanation for a form of the Chi-Squared test that differs from the standard definition
I'm doing association analysis and I'm using a Chi-Squared test on a 2x2 contingency table.
The usual definition of the Chi-Squared test is given e.g. here and here, the term in the denominator is ...
- 153
0
votes
1
answer
633
views
What is the relationship between "significant difference" and "correlation"?
I'm working on my graduation research; one of the hypotheses I have is that there is a significant variation between male and female employees in their level of performance.
The t-test provided a p-...
- 1
1
vote
1
answer
155
views
clustering based on web pages viewed together
Let us say I know the number of pages users generally looked at in the same session over a period of time. I can obtain data like this:
...
- 1,957
2
votes
0
answers
799
views
Market Basket Analysis: How to deal with item sets with high Confidence, Lift, and ChiSquare but very low Support?
I am doing a market basket analysis with a very large set of items, that is over 200000 individual items, with the majority of them occurring very rarely.
For this reason my analysis only focuses on ...
- 153
1
vote
0
answers
29
views
Can I infer all subsets as frequent from a projection of WiFIsViz?
I am trying to understand what I can infer from a WiFIsViz diagram, where WiFIsViz means Effective Visualization of Frequent Itemsets. Here is a projection of the subsets ...
- 111
2
votes
0
answers
47
views
Leads and Ideas on Learning from disconnected data
Problem of learning patterns from disconnected data.
I have two independent discrete variables, D1 and D2, with information similar to tables in the images.
I do NOT have the broken down data for A+...
- 121
3
votes
1
answer
130
views
R Association rules - is my understanding correct?
I'm a developer and I've being playing around with R association rules to create a recommendation system. My stats understanding is a little basic. So I've created a set of rules with varying levels ...
4
votes
1
answer
249
views
How do I express this hypothesis using symbols?
I'm just making this up to understand the rules...
Claim: People wearing roller blades can get to places in lesser time than those who don't. (Assuming on foot)
Now, I'd like to express this using ...
- 789
1
vote
0
answers
60
views
Using Bray-Curtis distance for association rules
may be some one has this Experience:
I would like to find cannbalization in a transactions. I have read this nice essay P.29-30 it says that we could use Bray-Curtis distance to find cannibalization, ...
- 205
1
vote
1
answer
105
views
"Official" formulae for association rules?
Since I haven't found a good-enough package in Python for association rules learning, I am manually coding up my own.
However, I have seen conflicting information about exactly what the formulae for ...
- 646