Questions tagged [categorical-data]
Categorical (also called nominal) data can take on a limited number of possible values called categories. Categorical values "label", they do not "measure". Please use [ordinal-data] tag for discrete but ordered data types.
2,699
questions
0
votes
0answers
46 views
Encoding Ordinal categorical data using Python
I am trying to encode ordinal data. I found a post which suggests a way to do it.
Where to find a guide to encoding categorical features?
This seems to make sense. For nominal data, I would do the one-...
2
votes
0answers
40 views
chi-square when the cells are not independent
Imagine an experimental setup as follows: 30 subjects each make three preference judgements: they choose a color for each button shape. So, the raw subject data could look like:
...
0
votes
0answers
20 views
Wich analysis should I use for 2 or 3 ordinal predictors and 2 nominal outcomes?
I´m actually a bit confused.These are my variables:
-->predictor Variables: Ordinal Variable X (Low-high), Difficulty (low-middle-high)
-->control Variable: Confidence (low-high)
-->outcome Variables:...
0
votes
1answer
21 views
Estimate the effect of dummies with unbalanced data
Imagine having a factory with jobs of different complexity, and a few machines that can execute these jobs; a job can succeed or fail. However, jobs are not assigned completely randomly, there is some ...
5
votes
2answers
124 views
Why am I getting a different intercept in my regression model with categorical variables when I let them interact?
I'm comparing two regression models in R. Both use the same categorical variables the only difference is that in one I allow them to interact, the other I don't.
...
1
vote
1answer
27 views
How can one model the density of a distribution of choice?
I'm a bit new to stats, so I may be missing some fundamentals.
I'm interested estimating the density of a discrete distribution, so that I can obtain the probability of an unseen outcome.
I have ...
0
votes
1answer
24 views
Relationship between two categorical variable
I'm trying to check a relationship between two variable. one with three levels and other is with 7 levels.
one variable is ...
1
vote
0answers
26 views
Interpretaion Of ordinal logistic regression
I have one variable overall_sentiment with (Positive, Negative, Neutral) three levels. I have one more variable comments_created_at with (Monday, Tuesday, Wed, Thu, Fri, sat, sun) 7 levels. I have to ...
0
votes
0answers
10 views
Exhaustive Bipartition Search (Specific to light GBM or Catboost)
After searching extensively I am unable to find a detail explanation and clear example of how exhaustive bipartition search is used by LightGBM (light gradient boosting) as an 'optimal' solution for ...
0
votes
0answers
21 views
How to use ICC(intraclass correlation coefficient) to test the correlation between categorical and numerical variables?
I have a dataset with both numerical and categorical variables.I'm trying to test the correlation or say, strength of association between these two kinds of variables. I already tried the eta and eta ...
0
votes
1answer
265 views
Isolation forest with categorical data?
I understand how isolation forests can work with numeric data, but I wonder how it can work with categorical data?
Also, at least when working with Sci-kit-Learn, the recommendation I saw was to ...
1
vote
3answers
127 views
Cluster categorical data (survey data)
I have a dataset containing around 800 observations:
It's a dataset collected via a survey; each row is a dataset filled with information re. diet habits, physical activity, the fact of taking ...
0
votes
0answers
25 views
How do I combine the categories of a classification system to find the maximum reliability?
I described my study design in another question. Briefly, I recruited 16 unique raters to classify 35 items according to a seven-category classification system. I measured the interrater reliability ...
0
votes
0answers
30 views
Question about collinearity interaction
I'm running logistic regression for outcome on SBP (systolic blood pressure), DBP (diastolic blood pressure), BMI, and other covariates. Because SBP, BMI didn't show linear relationship with logit of ...
3
votes
1answer
66 views
How do you deal with factors, in factorial design, when some or all levels of a factor are meaningless for one or some levels of another factor?
( Introduction: My question is essentially neither about software nor about data preparation. It's about understanding a principle in statistics topic of factorial design of experiments. In reality I ...
0
votes
2answers
150 views
Overall significance of a categorical variables in logistic regression
I have seen two approaches in binary logistic regression with categorical independent variables (IV) with more than two levels. In one approach, a reference category for the IV is defined and the rest ...
0
votes
1answer
71 views
Hclust in R - Categorical data with multiple categories
I have a dataset with 266 observations with categorical variables of multiple categories. I am using the function hclust in R and the function ...
0
votes
0answers
14 views
How related are the categories of a categorical dependent variable
There is a set of numerical and categorical independent variables and one dependent variable that is categorical. Some of the categories are far to be related with the rest, but most of them are very ...
1
vote
2answers
16 views
How to test statistical significance of differences between before and after nominal data
I'm wondering what the best statistical test to run on my dissertation survey would be.
I'm investigating letting agents attitudes towards the recently introduced tenant fee ban in the UK. A survey ...
0
votes
0answers
22 views
“CATEGORICAL” predictor that varies both within and across clusters
Page 13 of THIS ARTICLE (top of the page) recommends that if a continuous predictor varies both within and across clusters, a strategy is to break that predictor into two predictors by:
(a) taking ...
0
votes
1answer
32 views
Interpreting a categorical feature's overall significance
There are several discussions with similar headings, e.g.
overall effects of categorical variables or
Overall Significance vs. Individual Variable Significance in Mutliple Regression or
Categorical ...
2
votes
1answer
101 views
How to specify latent variables for SEM with lavaan [closed]
I would like to use lavaan for SEM. Specifically I want to use the paper: "Original Article Maximum Likelihood for Cross-lagged Panel Models with Fixed Effects", by Paul D. Allison, Richard Williams, ...
0
votes
1answer
33 views
The amount of variables used in SEM models
I would like to use lavaan for SEM. I am have however struggling to get things running (I went through al the examples, but they always deal with these perfect datasets). The only thing that has ...
2
votes
1answer
26 views
Creating a covariance matrix for SEM
I would like to use lavaan for SEM. Specifically I want to use the paper: "Original Article Maximum Likelihood for Cross-lagged Panel Models with Fixed Effects", by Paul D. Allison, Richard Williams, ...
3
votes
0answers
28 views
A goodness of fit test for two discrete distributions with unequal variance?
I have a computer simulation in which a virtual agent end up in different areas of a layout based on several factors. There are 18 conditions, so the data (you can find the csv file for a toy dataset ...
0
votes
0answers
18 views
Logit analysis of binomial response in contigency tables with > 2 categorical predictors
Is it true that in binomial count contingency tables that have > 2 predictors of the counts, the MLE estimates of logistic regression parameters can be calculated directly from table values (i.e. ...
0
votes
0answers
16 views
Intercept meaning in group lasso
I have a database with categorical and continuous variable. My response variable is dichotomous and the indipendent variables are 4 factors (2 of them with roughly 10 levels and 2 dichotomous) and 20 ...
0
votes
0answers
18 views
From multiple Bayesian BetaBinomial bandits models, to logistic regression
Suppose I have a single categorical predictor $X_1$ with K>2 levels, and a binary outcome Y.
We have two objectives, in order of priority:
Identify if there is level $k$ in $X_1$ that significantly ...
1
vote
0answers
22 views
Correlation between 1D spatial categorical variables
I have two sets of data, representing presence/absence variables which vary along an axis (N=1e6):
position, value
1, present
2, present
3, absent
4, absent
..
...
0
votes
1answer
28 views
Categorical variable for Arima
Does Arima support the usage of categorical variable?
Some ways to get it working can be using one-hot encoding to represent categorical variables, but I am not sure how good it is.
0
votes
0answers
35 views
How to treat missing values in a continuous variable?
I have a classification problem and I am doing the data analysis. I came across a variable which is numeric continuous and have some missing values.
I checked the missing values and are real missing ...
0
votes
0answers
23 views
Best approach to an event detection classifier model
Probably my title is not as precise as I'd like it to, but bear with me, the problem is quite straightforward: I have daily time-series sales and stock data, from January to May, both in 2018 and 2019....
0
votes
0answers
43 views
How to tell if a set of MCMC chains mixed?
Let's say I have a Bayesian network with both numeric and categorical variables. I run several MCMC chains to collect samples from the distribution. Now, if the chains are "similar enough" after some ...
0
votes
1answer
24 views
logistic regression with conflicting results, so to speak
I was trying to duplicate values by running the same set of data, and my coefficients were different. there is one 0-1 dependent variable, and there are four 0-1 independent variables. I found out ...
0
votes
1answer
38 views
Repeated-measure contingency table with two variables with many levels
I am trying to analyze the results of a survey on what would make people of different ages visit certain tourist places.
However, age was collected as age-group (not my fault). Hence, it is a ...
1
vote
1answer
38 views
Which level of factor (categorical variable) is assigned “the parameter value”?
Here is an example in Zuur's book about GAM. The data file (Bailey fisheries data) and R code (Chapter2.R) can be found in his website. Below I describe what I confuse.
We want to exam whether the ...
1
vote
1answer
81 views
Check if dropout rates are independent for an interaction of two independent variables (one with a large amount of levels)
I am trying to analyse dropout rates in an experiment, but there are multiple issues which collide, and I don't know how to deal with them as a whole. First, find a list of those issues. Below, see a ...
0
votes
1answer
20 views
How to compare frequencies among groups?
I want to compare the frequency of a categorical value among 4 groups, what statistical test should I use? (I am using SPSS).
I am looking for a statistical test that would allow me to say: the ...
0
votes
1answer
70 views
Visualization associations between the symptoms - categorical data in R
I have a data frame with presence of symptoms which are categorical data (1 = present, 0 = absent).
For instance:
...
0
votes
1answer
16 views
compare subjective participants choices
I am categorising photographs into one of three categories based on a subjective appraisal of the photo contents.
I wanted to test how 'subjective' the method is by asking 7 other people to classify ...
1
vote
1answer
41 views
Within sample and between sample categorical variation
I don't really know the correct terminology to ask this question well, so bear with me. I have categorical data with counts and I want a measure of how "diverse" or "spread out" the data is. Variance ...
0
votes
0answers
6 views
Excluding a feature when creating model to detect bias in outcomes?
Here's a hypothetical example. Let's imagine I am trying to determine if my hiring process is biased against Females. The way I want to calculate "bias against Females" is by ensuring the positive ...
1
vote
1answer
58 views
Variance (maybe?) of categorical data
I don't really know the correct terminology to ask this question well. I have categorical data with counts and I want a measure of how "diverse" or "spread out" the data is. Variance comes to mind, ...
1
vote
0answers
9 views
How to identify important categories in categorical variable to predict some binary variable?
Imagine that we have two sets of data. The first one contains information about websites visited by certain users:
...
0
votes
0answers
31 views
Predictor variable with uneven group sizes
I'm running a logistic regression with a categorical independent variable. My categorical IV (an ordinal none, low, medium, high) has a pretty uneven distribution: None (4.28%), Low (36.30%, Medium 30....
0
votes
0answers
18 views
Panel data model to test dummy variable IV with little variation
I have never done estimation with panel data, but I want to test the impact of using a particular service on the probation rates in a state's court districts (N=22). I have a balanced data set with ...
0
votes
1answer
15 views
Association between 2 outcomes and 4 variables
I am need some help. I have two outcomes and 4 different variables and I want to see which outcome is much more likely with a particular variable. Please see this table.
I am unsure what statistical ...
1
vote
1answer
30 views
I ran my ANOVA on my data, now how can I use the results to minimize my response?
I performed an ANOVA on my dataset and I have determined which predictors are significant and which are not. Now I need to minimize my response variable in order to predict which combination of 2 ...
2
votes
1answer
33 views
Are there any situations where ANOVA performs better/is more useful than Tukey's HSD?
In statistics this week we are learning about ANOVA and Tukey's HSD.
If ANOVA only tells you whether the differences in the means of the groups are significant, but Tukey's HSD gives you the ...
0
votes
0answers
24 views
Choosing the best aggregation location measure
I'm trying to analyze a granular dataset that is composed as follows:
...
