Questions tagged [association-rules]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
16 views

Interpreting association rules

I'm using mlxtend to find association rules in a dataset of products that customer bought over the span of a month. You can see an example of how it is used here. The dataset has around 1000 types of ...
1
vote
0answers
19 views

Are there any assumptions about row/column margins in a chi2 test?

I just learned that most tests of associations on 2x2 tables have assumptions about row and column margins being fixed or not. Is there any similar assumption when it comes to chi2 tests? Can I do ...
0
votes
0answers
16 views

Group Matrix Visualization in arulesViz Package

I want to visualize the rules package found in sample Groceries data in arules package using group matrix. However, I found it inconsistent with the inspect result. I use the following code ...
0
votes
2answers
65 views

How to binarize data for FP Growth in Weka?

I have a CSV file where all comlumns contains numerical values except for the quality column which contains nominal values. I want to use FP Growth Weka algorithm ...
0
votes
0answers
13 views

association rule graph understanding

What does the direction of arrows stand for? Some arrow going into the bubble, and some arrows pointing out the bubble to a specific item. Very lost.
0
votes
0answers
12 views

classification association rules and closed frequent itemsets

if I need to mine all frequent itemsets for text classification using classification association rules. what is the most efficient algorithm? is CHARM algorithm efficient with mining only closed ...
0
votes
0answers
13 views

Confidence vs. Count in association rule mining: which one is better?

I am writing a program that mines association rules from a large data set. I have an array of association rules, and I have to decide which ones are more representative of the patterns I am studying. ...
0
votes
0answers
19 views

Optimation Association Rule Using Genetic Algorithm

i have association rules that i got from FP-Growth algorithm and i want to optimize that association rules using Genetic Algorithm so i can get the strong rules. Does anyone know how to bring the ...
0
votes
0answers
69 views

How to mining association rules in very unbalanced dataset

I have a dataset of a large groceries store with more than 95% of products with very low support. When I generate rules with the apriori algorithm most rules have RHS equal to some product in the high ...
0
votes
0answers
23 views

How to reduce the number of rules in decision tree with Support and Confidence

The following is a set of rules in decison tree. How to reduce the number of rules in the set with Support and Confidence? If Ascites = 'Yes' then if Class = 'Live' then if Spiders = 'Yes' then if ...
0
votes
1answer
38 views

Association rule lift ratio converging to 0.5, is it not independent?

As far as I know, lift is a measure used in association rules to see whether there is a positive association between two items(instances?) I've done a simple (possibly wrong) simulation with lift ...
0
votes
1answer
25 views

Indirect clustering / association finding

I'm looking for recommendations of techniques that allow me to cluster or find associated items, through an indirect layer. Imagine a hypothetical database of information about patients, including ...
2
votes
1answer
35 views

Test if P(A) and P(A|b) are statistically different

I am using Apriori to find association rules, where each instance is a vector of True/False value, indicating whether an item is bought or not. Suppose that we obtain a rule b=>a with confidence c, ...
1
vote
1answer
28 views

In association rule mining, is it okay to disregard single item purchases?

I'm doing a market basket analysis of items purchases in particular stores. Each dataset contains over 5 million transactions. I'm currently processing this in R, but it seems my computer can't handle ...
1
vote
1answer
36 views

Which is the state of the art regarding methods for Association rule learning?

I have a set of data about which I would like as a first step, discover some interesting or frequent relationships. For this I know that there are several algorithms, like association or sequence ...
1
vote
0answers
293 views

Association rules between many continuous variables

I have a large dataset and I'm trying to mining association rules between the variables. My problem is that I have 160 variables among which I have to look for the association rules and also I have ...
0
votes
2answers
51 views

Rule between Inputs and Outputs

I have a set of 5 binary inputs and for each there are a set of 5 binary outputs. I would like to know what technique one could use to find the rule between them..? I've used Machine Learning in then ...
2
votes
0answers
2k views

Intuitive meaning behind support, confidence, lift and conviction

I'm learning about association rules and came across the common interestingness measures support, confidence, lift and conviction. I'm interested in the intuition behind your decision-making process ...
2
votes
1answer
368 views

Association Rules by Apriori Algorithm - How to read them?

Let's consider mining of the association rules for basket analysis at a petrol station. It is obvious that most people buy petrol, some of them something extra. The following implications are valid: ...
1
vote
0answers
153 views

What do Association Rules add beyond “standard” conditional probability?

I'm hoping that people will indulge me a beginner question, but I was recently learning about association rule learning from a lecture on Information Retrieval. (For reference, the video I was ...
1
vote
1answer
210 views

How to check cross validation scores for market basket analysis?

If I have a large set of transactions where in each I buy a set of goods and I want to do market basket analysis using either A-priori or FP Growth or any other data mining method, you typically get ...
1
vote
1answer
737 views

What is the confidence for rule for $\emptyset \implies A $?

I'm looking at a question for association rule mining and this comes up: What is the confidence for $\emptyset \implies A $? What is the confidence for $ A \implies \emptyset $? Given: $$\...
0
votes
2answers
71 views

Basic combinatorics for rule learning

This is supposed to be a rather rudimentary combinatorics problem, however, I can't seem to wrap my head around it. The Problem There are 40 distinct items, one person can pick (up to) 3 items. To ...
1
vote
1answer
1k views

R Arules Market Basket Analysis Redundant Rules Approaches [closed]

Using R and arules. I see several opinions on how to remove redundant rules which give different answers. If this is my example dataset: ...
1
vote
0answers
49 views

Can inferencing come from incomplete rule sets?

I have some data for medical diagnosis, consisting of some rules about relationship of diseases and their symptoms, for example disease D1 frequently has symptom S1 ...
0
votes
1answer
154 views

Interest measure for frequent itemsets in databases of different size

Consider a market basket analysis: Among a certain number of transactions two items sometimes occur together. For simplicity let's assume they always occur together, but not in all transactions. Now ...
2
votes
0answers
108 views

Covariates in a case control study

I am doing a retrospective analysis on a study has has cases and controls. I am looking to see if there is an association with death, using exact logistic regression. I am confused on whether I need ...
0
votes
1answer
2k views

How does term association work in text mining

Before performing word association, we create a term document matrix after removing punctuations, capitals, etc. How does the association algorithm work? Since we have removed the markers to identify ...
1
vote
1answer
376 views

Why are all my lift values the same?

I'm trying to measure association in my basket based on transactions. Let's imagine I have 5 products. Then, I calculate the number of client who bought product A and B, A and C, B and C and so on. ...
0
votes
1answer
884 views

Weka PART algorithm output

I am using Weka PART on my data set, and it is providing the rules below: ...
3
votes
1answer
384 views

Need explanation for a form of the Chi-Squared test that differs from the standard definition

I'm doing association analysis and I'm using a Chi-Squared test on a 2x2 contingency table. The usual definition of the Chi-Squared test is given e.g. here and here, the term in the denominator is ...
0
votes
1answer
280 views

What is the relationship between “significant difference” and “correlation”?

I'm working on my graduation research; one of the hypotheses I have is that there is a significant variation between male and female employees in their level of performance. The t-test provided a p-...
0
votes
1answer
33 views

clustering based on web pages viewed together

Let us say I know the number of pages users generally looked at in the same session over a period of time. I can obtain data like this: ...
1
vote
0answers
533 views

Market Basket Analysis: How to deal with item sets with high Confidence, Lift, and ChiSquare but very low Support?

I am doing a market basket analysis with a very large set of items, that is over 200000 individual items, with the majority of them occurring very rarely. For this reason my analysis only focuses on ...
1
vote
0answers
24 views

Can I infer all subsets as frequent from a projection of WiFIsViz?

I am trying to understand what I can infer from a WiFIsViz diagram, where WiFIsViz means Effective Visualization of Frequent Itemsets. Here is a projection of the subsets ...
2
votes
0answers
28 views

Leads and Ideas on Learning from disconnected data

Problem of learning patterns from disconnected data. I have two independent discrete variables, D1 and D2, with information similar to tables in the images. I do NOT have the broken down data for A+...
3
votes
1answer
111 views

R Association rules - is my understanding correct?

I'm a developer and I've being playing around with R association rules to create a recommendation system. My stats understanding is a little basic. So I've created a set of rules with varying levels ...
3
votes
1answer
218 views

How do I express this hypothesis using symbols?

I'm just making this up to understand the rules... Claim: People wearing roller blades can get to places in lesser time than those who don't. (Assuming on foot) Now, I'd like to express this using ...
1
vote
0answers
48 views

Using Bray-Curtis distance for association rules

may be some one has this Experience: I would like to find cannbalization in a transactions. I have read this nice essay P.29-30 it says that we could use Bray-Curtis distance to find cannibalization, ...
0
votes
1answer
71 views

“Official” formulae for association rules?

Since I haven't found a good-enough package in Python for association rules learning, I am manually coding up my own. However, I have seen conflicting information about exactly what the formulae for ...
1
vote
0answers
10 views

Reducing the amount of negations in (binary) rule induction mining

I have been using rule induction mining (e.g., using C4.5) to extract rules out of healthcare and text data sets (binary features and outcome) but I always end up with rules containing way more ...
2
votes
2answers
996 views

(Probability) Association rules - LIFT is useless?

Assume we have a rule {X} -> {Y} which means customers buy item X, they also buy item Y in a supermarket. I know the LIFT is used to measure the independence of X and Y which is equal $P(XY)/P(X)P(Y)$,...
5
votes
1answer
19k views

Association rules - support, confidence and lift

I am trying to mine association rules from my transaction dataset and I have questions regarding the support, confidence and lift of a rule. Assume we have rule like {X} -> {Y} I know that support ...
0
votes
1answer
262 views

How do apriori based algorithms avoid finding spurious relationships in their rules?

I'm taking a class on data mining and of course, we went over the Apriori algorithm (Fast Algorithms for Mining Association Rules). Something that I want to know is how do apriori based algorithms ...
0
votes
2answers
2k views

Interpreting association rules correctly?

I working on a problem to identify subgroups within a population. After writing some code to get my data into the correct format I was able to use the apriori algorithm for association rule mining. ...
3
votes
2answers
2k views

Which statistical models are suitable for prediction with clickstream data?

I'm a Statistics student, and I'm thinking of writing my master's thesis on clickstream data analysis. For my analysis I have a pretty big dataset (80 million rows), each of them being a click "...
1
vote
1answer
4k views

Market Basket Analysis using Clustering to discover *new* product combinations

I have transaction data from a Quick Service Restaurant (QSR) client. Each record in this data set represents a transaction. My objective is to discover products that are the best candidates to be ...
0
votes
2answers
96 views

“Controlling” for multiple sequential association rules?

Assume I have data along the following lines A-A-B-C A-A-B-C A-A-B-C Then I test the following sequential association rule: "A-A precedes C", which is true 100% ...
0
votes
1answer
19 views

How can I formally describe the count function of the support measure of frequent itemsets

currently composing a lecture on Association Rule Mining, Frequent Item sets. Therefore I need to formally describe the count function of the support measure as occurring int the following forumula : ...