Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [association-rules]

The tag has no usage guidance.

0
votes
0answers
6 views

Optimation Association Rule Using Genetic Algorithm

i have association rules that i got from FP-Growth algorithm and i want to optimize that association rules using Genetic Algorithm so i can get the strong rules. Does anyone know how to bring the ...
0
votes
0answers
22 views

How to mining association rules in very unbalanced dataset

I have a dataset of a large groceries store with more than 95% of products with very low support. When I generate rules with the apriori algorithm most rules have RHS equal to some product in the high ...
0
votes
0answers
15 views

How to reduce the number of rules in decision tree with Support and Confidence

The following is a set of rules in decison tree. How to reduce the number of rules in the set with Support and Confidence? If Ascites = 'Yes' then if Class = 'Live' then if Spiders = 'Yes' then if ...
0
votes
1answer
27 views

Association rule lift ratio converging to 0.5, is it not independent?

As far as I know, lift is a measure used in association rules to see whether there is a positive association between two items(instances?) I've done a simple (possibly wrong) simulation with lift ...
0
votes
0answers
7 views

Find association rules between events and a failure

I am dealing with machine that provide logs of its current activity. These logs have over 4000 different messages (Info,Warning,Error,...). I would like to predict a failure of that machine using ...
0
votes
1answer
17 views

Indirect clustering / association finding

I'm looking for recommendations of techniques that allow me to cluster or find associated items, through an indirect layer. Imagine a hypothetical database of information about patients, including ...
2
votes
1answer
35 views

Test if P(A) and P(A|b) are statistically different

I am using Apriori to find association rules, where each instance is a vector of True/False value, indicating whether an item is bought or not. Suppose that we obtain a rule b=>a with confidence c, ...
0
votes
0answers
45 views

Techniques to optimise association rule mining on high dimensionality dataset

I have a dataset of electronic health records with about 370 observations (each representing a patient) and many features, about 8000. Each feature is a binary True/False indicating the presence or ...
0
votes
0answers
22 views

Identifying patterns in search data and their temporal trend

The data The schema for the dataset is: userId | sessionId | timestamp | search_term Where search_term is a categorical variable with a relatively high domain cardinality (they are locations, so ...
1
vote
1answer
23 views

In association rule mining, is it okay to disregard single item purchases?

I'm doing a market basket analysis of items purchases in particular stores. Each dataset contains over 5 million transactions. I'm currently processing this in R, but it seems my computer can't handle ...
1
vote
1answer
32 views

Which is the state of the art regarding methods for Association rule learning?

I have a set of data about which I would like as a first step, discover some interesting or frequent relationships. For this I know that there are several algorithms, like association or sequence ...
1
vote
0answers
241 views

Association rules between many continuous variables

I have a large dataset and I'm trying to mining association rules between the variables. My problem is that I have 160 variables among which I have to look for the association rules and also I have ...
0
votes
2answers
48 views

Rule between Inputs and Outputs

I have a set of 5 binary inputs and for each there are a set of 5 binary outputs. I would like to know what technique one could use to find the rule between them..? I've used Machine Learning in then ...
2
votes
0answers
2k views

Intuitive meaning behind support, confidence, lift and conviction

I'm learning about association rules and came across the common interestingness measures support, confidence, lift and conviction. I'm interested in the intuition behind your decision-making process ...
1
vote
1answer
249 views

Association Rules by Apriori Algorithm - How to read them?

Let's consider mining of the association rules for basket analysis at a petrol station. It is obvious that most people buy petrol, some of them something extra. The following implications are valid: ...
1
vote
0answers
121 views

What do Association Rules add beyond “standard” conditional probability?

I'm hoping that people will indulge me a beginner question, but I was recently learning about association rule learning from a lecture on Information Retrieval. (For reference, the video I was ...
1
vote
0answers
181 views

How to check cross validation scores for market basket analysis?

If I have a large set of transactions where in each I buy a set of goods and I want to do market basket analysis using either A-priori or FP Growth or any other data mining method, you typically get ...
1
vote
1answer
497 views

What is the confidence for rule for $\emptyset \implies A $?

I'm looking at a question for association rule mining and this comes up: What is the confidence for $\emptyset \implies A $? What is the confidence for $ A \implies \emptyset $? Given: $$\...
0
votes
2answers
67 views

Basic combinatorics for rule learning

This is supposed to be a rather rudimentary combinatorics problem, however, I can't seem to wrap my head around it. The Problem There are 40 distinct items, one person can pick (up to) 3 items. To ...
1
vote
1answer
1k views

R Arules Market Basket Analysis Redundant Rules Approaches [closed]

Using R and arules. I see several opinions on how to remove redundant rules which give different answers. If this is my example dataset: ...
1
vote
0answers
49 views

Can inferencing come from incomplete rule sets?

I have some data for medical diagnosis, consisting of some rules about relationship of diseases and their symptoms, for example disease D1 frequently has symptom S1 ...
0
votes
0answers
28 views

When do players purchase?

I am working on analysing the purchase points of virtual items in a game. I have player game data such as when was she active/how many games played etc.. and the purchase information (time, amount ...
0
votes
1answer
136 views

Interest measure for frequent itemsets in databases of different size

Consider a market basket analysis: Among a certain number of transactions two items sometimes occur together. For simplicity let's assume they always occur together, but not in all transactions. Now ...
3
votes
0answers
91 views

Covariates in a case control study

I am doing a retrospective analysis on a study has has cases and controls. I am looking to see if there is an association with death, using exact logistic regression. I am confused on whether I need ...
0
votes
1answer
1k views

How does term association work in text mining

Before performing word association, we create a term document matrix after removing punctuations, capitals, etc. How does the association algorithm work? Since we have removed the markers to identify ...
1
vote
1answer
313 views

Why are all my lift values the same?

I'm trying to measure association in my basket based on transactions. Let's imagine I have 5 products. Then, I calculate the number of client who bought product A and B, A and C, B and C and so on. ...
0
votes
1answer
786 views

Weka PART algorithm output

I am using Weka PART on my data set, and it is providing the rules below: ...
3
votes
1answer
367 views

Need explanation for a form of the Chi-Squared test that differs from the standard definition

I'm doing association analysis and I'm using a Chi-Squared test on a 2x2 contingency table. The usual definition of the Chi-Squared test is given e.g. here and here, the term in the denominator is ...
0
votes
1answer
253 views

What is the relationship between “significant difference” and “correlation”?

I'm working on my graduation research; one of the hypotheses I have is that there is a significant variation between male and female employees in their level of performance. The t-test provided a p-...
0
votes
1answer
32 views

clustering based on web pages viewed together

Let us say I know the number of pages users generally looked at in the same session over a period of time. I can obtain data like this: ...
1
vote
0answers
462 views

Market Basket Analysis: How to deal with item sets with high Confidence, Lift, and ChiSquare but very low Support?

I am doing a market basket analysis with a very large set of items, that is over 200000 individual items, with the majority of them occurring very rarely. For this reason my analysis only focuses on ...
1
vote
0answers
24 views

Can I infer all subsets as frequent from a projection of WiFIsViz?

I am trying to understand what I can infer from a WiFIsViz diagram, where WiFIsViz means Effective Visualization of Frequent Itemsets. Here is a projection of the subsets ...
2
votes
0answers
28 views

Leads and Ideas on Learning from disconnected data

Problem of learning patterns from disconnected data. I have two independent discrete variables, D1 and D2, with information similar to tables in the images. I do NOT have the broken down data for A+...
3
votes
1answer
105 views

R Association rules - is my understanding correct?

I'm a developer and I've being playing around with R association rules to create a recommendation system. My stats understanding is a little basic. So I've created a set of rules with varying levels ...
3
votes
1answer
206 views

How do I express this hypothesis using symbols?

I'm just making this up to understand the rules... Claim: People wearing roller blades can get to places in lesser time than those who don't. (Assuming on foot) Now, I'd like to express this using ...
1
vote
0answers
33 views

Using Bray-Curtis distance for association rules

may be some one has this Experience: I would like to find cannbalization in a transactions. I have read this nice essay P.29-30 it says that we could use Bray-Curtis distance to find cannibalization, ...
0
votes
1answer
57 views

“Official” formulae for association rules?

Since I haven't found a good-enough package in Python for association rules learning, I am manually coding up my own. However, I have seen conflicting information about exactly what the formulae for ...
1
vote
0answers
10 views

Reducing the amount of negations in (binary) rule induction mining

I have been using rule induction mining (e.g., using C4.5) to extract rules out of healthcare and text data sets (binary features and outcome) but I always end up with rules containing way more ...
2
votes
2answers
859 views

(Probability) Association rules - LIFT is useless?

Assume we have a rule {X} -> {Y} which means customers buy item X, they also buy item Y in a supermarket. I know the LIFT is used to measure the independence of X and Y which is equal $P(XY)/P(X)P(Y)$,...
3
votes
1answer
17k views

Association rules - support, confidence and lift

I am trying to mine association rules from my transaction dataset and I have questions regarding the support, confidence and lift of a rule. Assume we have rule like {X} -> {Y} I know that support ...
0
votes
1answer
197 views

How do apriori based algorithms avoid finding spurious relationships in their rules?

I'm taking a class on data mining and of course, we went over the Apriori algorithm (Fast Algorithms for Mining Association Rules). Something that I want to know is how do apriori based algorithms ...
0
votes
2answers
2k views

Interpreting association rules correctly?

I working on a problem to identify subgroups within a population. After writing some code to get my data into the correct format I was able to use the apriori algorithm for association rule mining. ...
3
votes
2answers
2k views

Which statistical models are suitable for prediction with clickstream data?

I'm a Statistics student, and I'm thinking of writing my master's thesis on clickstream data analysis. For my analysis I have a pretty big dataset (80 million rows), each of them being a click "...
0
votes
1answer
4k views

Market Basket Analysis using Clustering to discover *new* product combinations

I have transaction data from a Quick Service Restaurant (QSR) client. Each record in this data set represents a transaction. My objective is to discover products that are the best candidates to be ...
0
votes
2answers
92 views

“Controlling” for multiple sequential association rules?

Assume I have data along the following lines A-A-B-C A-A-B-C A-A-B-C Then I test the following sequential association rule: "A-A precedes C", which is true 100% ...
0
votes
1answer
18 views

How can I formally describe the count function of the support measure of frequent itemsets

currently composing a lecture on Association Rule Mining, Frequent Item sets. Therefore I need to formally describe the count function of the support measure as occurring int the following forumula : ...
3
votes
1answer
2k views

How can I cluster products based on market basket data?

I need to cluster products based on market basket data, i.e. I have a data table with sold products and the respective orders and I want to cluster products so that products within a group are bought ...
2
votes
1answer
5k views

How is the support calculated using hash trees for Apriori algorithm?

I started studying association rules and specially the Apriori algorithm through this free chapter. I understood most of the points in relation with this algorithm except the one on how to build the ...
3
votes
1answer
120 views

For association rules, does it make sense to plot a learning curve using the lift measure?

As I understand, the learning curve is normally plotted as accuracy vs. sample size. However, accuracy takes true negatives into account. When doing association rule mining, true negatives aren't very ...
-1
votes
1answer
114 views

What test should I run to show if there is a correlation between two binary variables?

I have two variable religion and healthy. The answers are coded as yes or no. I want to see if health is related to religion.