Questions tagged [categorical-data]
Categorical (also called nominal) data can take on a limited number of possible values called categories. Categorical values "label", they do not "measure". Please use [ordinal-data] tag for discrete but ordered data types.
2,995
questions
0
votes
0answers
8 views
Estimation of Conditional Probability of Two Categorical Distributions
I trained a neural network model that can predict how much a given legal article could be cited for a given case description.
In this model, if I feed the neural network with two different arguments -
...
0
votes
0answers
25 views
One hot encode nominal categorical variables for random forest? [duplicate]
I looked for this before but I couldn't find it exactly, so let me know if it's a duplicate.
My question is, should categorical variables be one hot encoded to run Random forests? Or just transforming ...
0
votes
1answer
32 views
Analyzing Relationship across Categorical Variables
I am working on some corpus data related to semantic tagging and syntactic constructions. Finally, I prepared a table of results yet I am unable to go on further due to lack of statistical knowledge.
...
0
votes
0answers
10 views
Should I log a variable that is not normally distributed to be able to make categories for crosstabs?
I’m researching the correlation between democracy and the amount of foreign aid per capita received
in developing countries. My database contains panel data from the same population (N=121) in ...
0
votes
0answers
11 views
Adding categorical features to each pixel of an image for use in CNN model
I am building a model which generates new image from an imput image. I have a training set of input images and desired generated images and I also have some categorical data for each pixel of an image ...
0
votes
0answers
22 views
Poor performance using Neural Networks
I have the below dataset which tells the number of visitors at different locations. I am trying to predict the 'Count_in' column which describes the count of the visitors at a given location and a ...
0
votes
1answer
23 views
selecting principal component for wealth index?
While creating a wealth index using the household asset (dichotomized
), Can we take the second principal component (comp 2) if it has more relative positive eigenvectors (For example: as shown in the ...
0
votes
0answers
20 views
Analyze which level of a categorical variable has changed the most between two given distributions
I want to analyze whether the frequencies of a categorical variable X (e.g. icecream color) collected in a second survey are higher or lower than in a first survey.
I know that one can use Chi-square ...
0
votes
0answers
17 views
Multicollinearity in multiple linear regression with only categorial variables
I have to do a multiple linear regression with a numeric dependent variable and three categorial variables (2x2x4) as independent variables. Do I have to check for multicollinearity and if so, why and ...
1
vote
1answer
15 views
How to identify coefficients for all levels of categorical variables when you have multiple of them
I have an equation like y ~ x1 + x2 + x3 + x4 where the first 3 variables are categorical and the last one is continues. I want to identify the coefficients for all ...
0
votes
0answers
57 views
How to find the optimal cut point of a categorical variable?
I have two categorical variables (x and z) as shown in the frequency plot below. Y-axis is the count of variable x.
As evident in this plot, there is a clear relationship between x and z variables. I ...
0
votes
1answer
20 views
Is it reasonable to convert factor (only 0/1 involved) into numeric data?
If I have a simple data with only 2 levels of factors:
...
0
votes
0answers
8 views
Regression between two interest rates
I am trying to predict one interest rate that depends on the other. When Plotting it on scatter plot the relationship is mostly linear in the middle part of the curve. The only issue is on the extreme ...
4
votes
1answer
47 views
How to use an F-test to understand if a categorical input is statistically significant?
I am trying to understand F-tests in general and how to apply one for a particular problem for a data set in "Introduction to Statistical Learning with Applications in R".
The data set is ...
1
vote
1answer
30 views
Interpretation the correlation between continuous and categorical variables
Question
I implemented the approach mentioned in this answer and applied it to a car dataset, where I am focused on the correlation between brand (categorical) and the price (continuous variable). The ...
0
votes
0answers
41 views
Logistic regression coefficient interpretation
There is one binary dependent variable (Winner/Loser) and there are three independent variables which are also categorical in nature:
Age (Below 31, 31-40, 41-50, 51-60, 61 and above while retaining ...
1
vote
0answers
44 views
How to correct zero cell counts for odds ratio calculations when variable has >2 categories
I am trying to calculate odds ratios for several univariate models with a binomial outcome.
The problem is, for some of my variables, I have at least 1 zero count cell.
It seems that the Haldane ...
0
votes
0answers
22 views
Interpreting logistic mixed model estimates of a model with continuous and categorical predictors
Newbie here. Sorry in advance if I express poorly as I don't completely master yet the vocabulary of statistics!
I am performing a logisctic mixed model - with glmer - which presents as follows:
CE ~ ...
0
votes
0answers
6 views
Creating an index using transactional data
I have a dataset of a series of leases.
Variables we have: precinct, date (in quarters), lettable area, price as well as a few others.
These assets are not homogenous, although are comparable.
In some ...
0
votes
1answer
26 views
Ordinal vs. Nominal?
Say I have a dataset of patient information, and some variable X representing labels for degree of a burn, with possible values of X = {1,2,3,4,5}:
1: First-Degree Burn
2: Second-Degree Burn
3: Third-...
0
votes
0answers
15 views
The most important matrices for evaluating a predictive model for customer churn
My questions is as above. What are the most important matrices (f1, precision, recall...etc) that I need to prioritize my work to improve for evaluating how good a model predict customer churn and the ...
0
votes
0answers
22 views
Multiple regression: Is it acceptable to include a categorical covariate with few observations across levels?
I am interested in the influence of age and body mass index (bmi) on brain size in a patient group. I have the following multiple regression model (using R): ...
2
votes
1answer
42 views
Best solution for sports statistics [closed]
I have created a floorball sports statistics in excel. It works like this: I put in data from each match (mininal required data like who was present and who scored etc.) and then I have sheets which ...
0
votes
1answer
68 views
Checking the normality and assumptions of residuals in a regression model with a categorical IV
I have conducted a hierarchical regression with 2 categorical variables. One of which I am controlling for (ethnicity-dummy coded).
I need to check the assumptions of normality, linearity and ...
0
votes
0answers
24 views
correlation between discrete and continuous variable
Suppose I collect data of three variables $X_1$, $X_2$ and $X_3$, where $X_1$ and $X_2$ are continuous and $X_3$ is discrete. I know that there are various measures of correlation between a continuous ...
0
votes
0answers
32 views
polychoric factor analysis and use of factor score in subsequent models
To predict the impact of gender egalitarianism on life satisfaction (7-scale ordinal variable), I wanted to create a factor score from a relevant group of variables (mothers should work: agree to ...
3
votes
1answer
103 views
Up to what number of distinct values should I transform a categorical variable in a dummy variable?
When working with categorical variables, it's common to do some sort of transformation. Usually people apply a one-hot encoding. Putting it simply, we transform a categorical into a dummy variable. ...
0
votes
0answers
25 views
General procedures to check conditions for hypothesis testing?
I am going to have a linear by linear test(lbl_test in R, and the related doc can be found here) but the math underlying it is still a mystery to me after trying my best to comprehend this ...
1
vote
1answer
26 views
Hypothesis testing that a sentiment appeared more often
Im new to statistics and have a question that I cant answer. It's also difficult for me to tell if an online guide has the right solution for my question. So any help from you would be great.
What I ...
0
votes
0answers
19 views
Statistical significance multiple groups categorical distribution
Apologies, am a complete novice. I think this question is about as close as I found.
I have a distribution of percentage data for a categorical variable as shown:
I want to test for two different ...
2
votes
1answer
33 views
Are the outcome and predictor variables in a logistic/linear regression interchangeable?
Consider the following example. I am studying the mutation burden across three subtypes of cancer. In my dataset, I have individuals without cancer (controls) and individuals with cancer (cases); the ...
1
vote
1answer
175 views
Optimal binning methods for categorical variables
I'm running a multinomial logit to predict the outcome of a categoric response variable.
I have both continuous and categoric independent variables, and I know it's bad practicde to bin the ...
1
vote
2answers
34 views
How to detect significant differences in the proportions of categorical variables?
I am working on a project related to the way in which a message to smokers is communicated to reduce their smoking. For my experiment I will give a questionnaire to smokers where, in each question, ...
0
votes
0answers
47 views
Comparing categorical variable results across multiple time points
I'd like to compare categorical variable results across multiple time points. In the example below, group 3 has a drop in positives from 14 to 4. As I understand it, contingency table tests such as ...
0
votes
0answers
33 views
0
votes
0answers
16 views
When splitting a dataset into train/dev/test sets, how perform stratified splits on some labels but exclusion split on others?
Suppose I have a dataset of 1000 samples with label classes A, B or C that I want to split into train/dev/test sets in a stratified fashion. However, each sample has an origin metadata (o1, o2, o3, ......
0
votes
0answers
17 views
Categorical data type
Suppose I send surveys out to students’ parents to assess how often parents seek tutors to help their children with schoolwork. Parents are selected from schools across the country. As part of my ...
1
vote
0answers
15 views
Type of correlation between binary and ordinal variable [duplicate]
I have two variables. The first variable is binary (yes or no) and measures if a person is happy or not. The second variable consists of 5 integers from 1 to 5 and measures if an emotion is positive ...
0
votes
1answer
40 views
Margins predicts all sizes to be higher than the mean?
I've got a dataset with size of an aneurysm as a binary variable (above or under a threshold) and location as a categorical variable. I'm interested to know whether any of the locations have ...
4
votes
1answer
90 views
Probability: Binomial data
If the true success probability for binomial data is close to 0.50, why would you expect to have less certainty with your mean parameter estimate than if the true success probability were closer to 0 ...
0
votes
0answers
62 views
Is it possible to combine confidence intervals of dummy coded categorical variables in linear regression?
Given below is the linear mixed-effects model output for outcome variable pfm( percent fat mass in infants) predicted by 2 categorical variables; ...
1
vote
0answers
28 views
Positive real vs. natural numbers in machine learning
When looking at data on answers to questions on a slider scale, which will yield positive real numbers, is there any possible scenario where one would discretize the data and thus turn it into real ...
1
vote
0answers
13 views
What to do when categorical variables have low crosstabs?
I am using an MLM model nesting counties in states. Some states have very small numbers of counties (n < 5). My intuition is telling me this is a problem, but I can't figure out how to phrase the ...
4
votes
1answer
81 views
Using n linear regression models for different subsets vs using one model for the entire dataset
I am working on the following regression problem:
1 dependent variable
m continuous features
1 categorical feature c with n possible values (giving a total of m + n continuous features)
My initial ...
2
votes
1answer
46 views
How to decide between presenting row percentages or column percentages when presenting a cross-tabulation?
I am trying to present the percentage distribution of three types of emotional states by several independent variables. A portion of the table for one of the independent variables, type of work, is ...
0
votes
1answer
16 views
2D convolution with values that encode categorical data
I have got raster images of the spatial distribution of categorical data. For each pixel of the image, I know which single category (A to F) is present in that pixel.
Each image belongs to a class ...
0
votes
0answers
22 views
Variability and uncertainty in estimating proportions and effect size
This is a more general question about estimating effect size with proportions. I am not an expert in statistics so maybe the question/statement is weird and trivial but I have some doubts.
I study ...
1
vote
1answer
2k views
How to check the correlation between categorical and numeric independent variable in R? [duplicate]
Just wondering if i need to check correlation between categorical and numeric independent variable in R, is there any specific package available in R. Or should i just find the correlation between the ...
0
votes
1answer
25 views
How to determine relationship categorical and numerical data
I have two data frames and I would like to determine correlation or another type of relationship between them.
The first data frame is consumption of soft drinks weekly (in liters).
...
0
votes
1answer
21 views
Could ANOVAs be used as a substitute for regression when doing mediation analysis?
I hope you can help me with these questions.
I am developing a mediation analysis using the mediation package in R.
I need to analyze the influence of perceived learning (Mediating Variable –MV-) in ...
