Questions tagged [association-rules]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
68 views

Including Association Analysis results into existing Classification Model

I have trained a classification model that predicts (returns a score) on how likely a customer is to buy from our company. This model does not contain any product specific data, but we nevertheless ...
0
votes
0answers
8 views

Reducing the number of generated candidates in the Apriori algorithm?

I'm currently reading about the Apriori algorithm and had a question regarding an exercise problem. The problem is: In market basket analysis, the the Apriori algorithm is used to find association ...
0
votes
1answer
14 views

What is the threshold for “frequent” in the Apriori algorithm?

I'm reading about the Apriori algorithm using the textbook Introduction to Machine Learning (Ethem Alpaydin) and had a question. I've noticed that the textbook and many other resources I find online ...
1
vote
1answer
32 views

Makes sense to do a Market Basket Analysis with transactions grouped by month (or week)?

Most of the articles on the internet shows the Market Basket Analysis using data from supermarket (i.e. clients uses to buy a lot of items in one day in a supermarket), so I think makes sense to group ...
0
votes
0answers
16 views

Parallel Coordinate Plots

I was curious if someone could describe to me what exactly this plot is showing specifically for Association rules? I believe it's showing that if I have one item which item will also buy (if we're ...
1
vote
1answer
27 views

Need some help simplifying an expression

The expression is: $=\sum_{i=1}^{M}[(\frac{1}{L})^N\frac{1}{M+1}] $
1
vote
0answers
13 views

How to encode categorical data when 1+ categories are more relevant than others?

Suppose to have a questionnaire that asks 2 questions: "What is your top 3 favorite food?" "What drink do you like?" I need to find association between the 1st answer given and ...
0
votes
0answers
11 views

Clarification on conviction metric in associative rule mining

From what I'm reading, conviction measures the error of the rule given that both X and Y are independent. For example, if X->Y has a conviction of 1.2, there is a 20% chance that X does not imply Y. ...
0
votes
0answers
13 views

One to many association rules in FP Growth algorithm

I have been using apriori algorithm in Python and it generates one to one(Bread -> Butter) as well as one to many rules(Bread -> Milk, Butter), but when I tried implementing the fpgrowth in pyspark on ...
0
votes
0answers
8 views

What is a good solution for mining association rules with fixed consequent?

I have a dataframe (many categories for each column) as follows: ...
0
votes
1answer
35 views

Association rules for congressional votes with missing values

Using the UCI dataset here: http://archive.ics.uci.edu/ml/datasets/Congressional+Voting+Records Each congressperson votes yay, nay or present (basically abstains) on 16 issues. My teacher wants us to ...
0
votes
0answers
12 views

Identifying frequent item sets for root cause analysis

I am planning to use the apriori or fp tree for root cause analysis of issues. I know the event which indicates the system reboot. I picked the last 5 minutes data prior to the system reboot. For ...
0
votes
0answers
17 views

What are some good implementations for FP-Growth Tree Algorithm available for association rule mining

I'm currently working with transaction set over 10 million records. I've tried FP-Growth from SPMF Library and also from PyFIM Library. For the same parameter values the two implementations give me ...
0
votes
0answers
18 views

Pruning Association Rules

I have applied the Apriori Algorithm to a dataset $X$ that generated a set $S$ of association rules. The $i=1,...,n$ entries $S_i$ of the set look like $$ S_i =\{ (a,b,c), (d), support, confidence, ...
2
votes
1answer
53 views

Using scatterplot before running a controlled experiment to test causality

This question is an extension of awesome thread Does causation imply correlation?. As an example, let's say that I am running an online experiment on Stackoverflow to see whether asking more ...
0
votes
0answers
17 views

Finding relations between events in a specific time window

i have following problem: I have a system containing several modules that, upon occurence of a problem, all send an event (containing an error code, time (is inaccurate thats why not really useful), ...
1
vote
0answers
22 views

Clustering binary data : feature selection vs Apriori

My data set is a 999 rows x 964 columns Panda DataFrame. Each row is a user. My data is binary : 0 for absent and 1 for present. I would like to fit the users ...
0
votes
0answers
50 views

Item Based Collaborative Filtering vs Association Rules In Data Mining vs Normalised Co-occurrence Similarity Matrix

Requirement: Find out how similar any two products are, in an e-commerce database, to suggest to the users, similar products, when they've added any product to the cart. Much similar to Amazon's ...
0
votes
1answer
27 views

can computers play word association games?

Suppose I give you these 6 English words: circle, low, Brian, sentence, support, wild and ask you to find a 7th word that is associated with all of them. You probably already know which one it is. ...
0
votes
0answers
27 views

Interpreting association rules

I'm using mlxtend to find association rules in a dataset of products that customer bought over the span of a month. You can see an example of how it is used here. The dataset has around 1000 types of ...
1
vote
0answers
26 views

Are there any assumptions about row/column margins in a chi2 test?

I just learned that most tests of associations on 2x2 tables have assumptions about row and column margins being fixed or not. Is there any similar assumption when it comes to chi2 tests? Can I do ...
1
vote
2answers
461 views

How to binarize data for FP Growth in Weka?

I have a CSV file where all comlumns contains numerical values except for the quality column which contains nominal values. I want to use FP Growth Weka algorithm ...
0
votes
1answer
70 views

Association rule lift ratio converging to 0.5, is it not independent?

As far as I know, lift is a measure used in association rules to see whether there is a positive association between two items(instances?) I've done a simple (possibly wrong) simulation with lift ...
0
votes
1answer
37 views

Indirect clustering / association finding

I'm looking for recommendations of techniques that allow me to cluster or find associated items, through an indirect layer. Imagine a hypothetical database of information about patients, including ...
2
votes
1answer
39 views

Test if P(A) and P(A|b) are statistically different

I am using Apriori to find association rules, where each instance is a vector of True/False value, indicating whether an item is bought or not. Suppose that we obtain a rule b=>a with confidence c, ...
1
vote
1answer
35 views

In association rule mining, is it okay to disregard single item purchases?

I'm doing a market basket analysis of items purchases in particular stores. Each dataset contains over 5 million transactions. I'm currently processing this in R, but it seems my computer can't handle ...
2
votes
1answer
85 views

Which is the state of the art regarding methods for Association rule learning?

I have a set of data about which I would like as a first step, discover some interesting or frequent relationships. For this I know that there are several algorithms, like association or sequence ...
1
vote
0answers
383 views

Association rules between many continuous variables

I have a large dataset and I'm trying to mining association rules between the variables. My problem is that I have 160 variables among which I have to look for the association rules and also I have ...
1
vote
2answers
54 views

Rule between Inputs and Outputs

I have a set of 5 binary inputs and for each there are a set of 5 binary outputs. I would like to know what technique one could use to find the rule between them..? I've used Machine Learning in then ...
3
votes
0answers
3k views

Intuitive meaning behind support, confidence, lift and conviction

I'm learning about association rules and came across the common interestingness measures support, confidence, lift and conviction. I'm interested in the intuition behind your decision-making process ...
2
votes
1answer
582 views

Association Rules by Apriori Algorithm - How to read them?

Let's consider mining of the association rules for basket analysis at a petrol station. It is obvious that most people buy petrol, some of them something extra. The following implications are valid: ...
1
vote
0answers
219 views

What do Association Rules add beyond “standard” conditional probability?

I'm hoping that people will indulge me a beginner question, but I was recently learning about association rule learning from a lecture on Information Retrieval. (For reference, the video I was ...
1
vote
1answer
271 views

How to check cross validation scores for market basket analysis?

If I have a large set of transactions where in each I buy a set of goods and I want to do market basket analysis using either A-priori or FP Growth or any other data mining method, you typically get ...
1
vote
1answer
1k views

What is the confidence for rule for $\emptyset \implies A $?

I'm looking at a question for association rule mining and this comes up: What is the confidence for $\emptyset \implies A $? What is the confidence for $ A \implies \emptyset $? Given: $$\...
0
votes
2answers
78 views

Basic combinatorics for rule learning

This is supposed to be a rather rudimentary combinatorics problem, however, I can't seem to wrap my head around it. The Problem There are 40 distinct items, one person can pick (up to) 3 items. To ...
1
vote
1answer
2k views

R Arules Market Basket Analysis Redundant Rules Approaches [closed]

Using R and arules. I see several opinions on how to remove redundant rules which give different answers. If this is my example dataset: ...
1
vote
0answers
50 views

Can inferencing come from incomplete rule sets?

I have some data for medical diagnosis, consisting of some rules about relationship of diseases and their symptoms, for example disease D1 frequently has symptom S1 ...
0
votes
1answer
172 views

Interest measure for frequent itemsets in databases of different size

Consider a market basket analysis: Among a certain number of transactions two items sometimes occur together. For simplicity let's assume they always occur together, but not in all transactions. Now ...
2
votes
0answers
152 views

Covariates in a case control study

I am doing a retrospective analysis on a study has has cases and controls. I am looking to see if there is an association with death, using exact logistic regression. I am confused on whether I need ...
0
votes
1answer
2k views

How does term association work in text mining

Before performing word association, we create a term document matrix after removing punctuations, capitals, etc. How does the association algorithm work? Since we have removed the markers to identify ...
2
votes
1answer
465 views

Why are all my lift values the same?

I'm trying to measure association in my basket based on transactions. Let's imagine I have 5 products. Then, I calculate the number of client who bought product A and B, A and C, B and C and so on. ...
0
votes
1answer
1k views

Weka PART algorithm output

I am using Weka PART on my data set, and it is providing the rules below: ...
3
votes
1answer
418 views

Need explanation for a form of the Chi-Squared test that differs from the standard definition

I'm doing association analysis and I'm using a Chi-Squared test on a 2x2 contingency table. The usual definition of the Chi-Squared test is given e.g. here and here, the term in the denominator is ...
0
votes
1answer
391 views

What is the relationship between “significant difference” and “correlation”?

I'm working on my graduation research; one of the hypotheses I have is that there is a significant variation between male and female employees in their level of performance. The t-test provided a p-...
0
votes
1answer
58 views

clustering based on web pages viewed together

Let us say I know the number of pages users generally looked at in the same session over a period of time. I can obtain data like this: ...
1
vote
0answers
631 views

Market Basket Analysis: How to deal with item sets with high Confidence, Lift, and ChiSquare but very low Support?

I am doing a market basket analysis with a very large set of items, that is over 200000 individual items, with the majority of them occurring very rarely. For this reason my analysis only focuses on ...
1
vote
0answers
25 views

Can I infer all subsets as frequent from a projection of WiFIsViz?

I am trying to understand what I can infer from a WiFIsViz diagram, where WiFIsViz means Effective Visualization of Frequent Itemsets. Here is a projection of the subsets ...
2
votes
0answers
33 views

Leads and Ideas on Learning from disconnected data

Problem of learning patterns from disconnected data. I have two independent discrete variables, D1 and D2, with information similar to tables in the images. I do NOT have the broken down data for A+...
3
votes
1answer
120 views

R Association rules - is my understanding correct?

I'm a developer and I've being playing around with R association rules to create a recommendation system. My stats understanding is a little basic. So I've created a set of rules with varying levels ...
3
votes
1answer
224 views

How do I express this hypothesis using symbols?

I'm just making this up to understand the rules... Claim: People wearing roller blades can get to places in lesser time than those who don't. (Assuming on foot) Now, I'd like to express this using ...