Questions tagged [mixed-type-data]
Dataset including variables of different measurement nature (e.g. continuous, categorical, binary, count etc.) analyzed together in one variable set. Use this tag when this presents a challenge for the analysis. Do NOT use to refer to [mixed-model].
123
questions
0
votes
0
answers
15
views
How to normalize dataset with mixed data (continuous and count)?
I am trying to determine what procedure should I use to feature engineer the most descriptive possible dataset to predict a binary outcome. The dataset has variables that are count-valued with ...
- 173
0
votes
0
answers
23
views
How to deal with a large dataset when implementing clustering?
I am working with what I believe is quite a big dataset, with $17$ columns (each corresponds to one variable) and $41714$ rows (each corresponds to one observations).
My goal is to implement ...
- 155
4
votes
2
answers
53
views
Should I pool multiple observations from the same experimental unit, or use mixed effects models
I am trying to assess the effects of an experimental treatment on the insect fauna of artificial ponds. The treatment is applied to the entire pond.
I was able to sample each pond four times, each ...
0
votes
0
answers
29
views
How to quantify the dissimilarity across different types of variables?
I have two dataframes with the same columns but with varying sample sizes. I want to compare corresponding columns for homogeneity (i.e., do they come from the same distribution?). There are different ...
- 411
1
vote
0
answers
33
views
Clustering mixed data - SPSS [closed]
On my current project, I have to form four or five clusters describing different types of banking customers. The data is based on a survey of around 3500 participants and contains more than 250 ...
- 11
1
vote
0
answers
59
views
Fractional factorial design with mixed categorical and numerical variables analysis for more than two levels
I have an experiment setup that consists of multiple continuous and multiple categorical variables. Right now, I am just using two levels for the categorical variables, allowing me to encode them as -...
- 111
0
votes
0
answers
25
views
Is this data time series or panel
I am working with a dataset of an online institution that is registered in one country, but has customers from across the world. I am working with a sample period of 5 months in 2022. I am unable to ...
- 205
1
vote
0
answers
136
views
Multilevel/ Mixed Model / HLM Centering Interactions Level 1 and Level 2 Cross-Level
I am having some trouble with the literature on the correct model specification for my question.
Here is the setup:
I have a multilevel model with a variety of variables at level 1 and a single level ...
- 11
2
votes
0
answers
52
views
Does persistent homology really make sense for mixed variable types?
Purpose
Persistent homology is a fascinating approach to exploring data (see Chazal & Michel 2021 for an introduction). I have seen many impressive examples of it through AATRN. I'm considering ...
- 6,217
1
vote
1
answer
159
views
Is applying dimension reduction to mixed type data valid for outlier detection after that?
I'm facing with anomaly detection (outlier detection) task with mixed (numerical and categorical) multi-feature data set. I understand that many of the possible multivariate outlier detection methods ...
- 223
0
votes
0
answers
68
views
Likelihood of mixed discrete-continuous data
I'm struggling with the derivation of the likelihood with mixed continuous and discrete variables. Let us take this simple example:
\begin{align*}
X &= \begin{cases}
0 & \text{with ...
- 157
1
vote
1
answer
20
views
High Performance Classification or Similarity Algorithim for Mixed Data Types?
I have a database holding 10-ish features that describe different breeds of dogs. They are mostly categorical features, but some provide ranges for values. Here's a demo representation of the database,...
1
vote
0
answers
333
views
How to choose a fair gamma value when performing k-prototypes clustering?
In the k-prototypes clustering algorithm, the distance function consists of two dissimilarity components - one for the numerical elements of the observations, and one for their categorical elements. ...
- 11
0
votes
0
answers
302
views
PCA or Drop high correlated variables for clustering
I am performing clustering on mixed data type. I have few features which are high correlated. We generally use PCA before clustering and reduce the feature space, as its a mixed data I have used FAMD ...
- 21
0
votes
1
answer
180
views
What is the data type of speed limit of a road network segment?
As you know the data type is one of the most important factors in selecting the Machine Learning algorithm. For example, K-means should not be employed for categorical data. I have a csv file ...
- 73
0
votes
0
answers
63
views
Clustering a dataset with mixed, skewed, semi-correlated and unscaled values
I have a dataset containing six features, around 13000 records, and representing an urban road network. I imported data as a dataframe into Jupyter and table below demonstrates the sample of this data....
- 73
0
votes
0
answers
160
views
Weighted metric for mixed binary (decomposed) data?
I have a large dataset with mixed type of data (example):
Age
Price
Town Size
Interests
Small
Middle
Big
Traveling
Cooking
TV
21
0
1
0
0
1
1
1
34
100
0
1
0
0
1
0
81
200
0
0
1
1
1
0
54
0
0
0
1
1
...
1
vote
0
answers
19
views
Best option for calculating distance/similarity for structured data with both categorical and numerical dimensions?
Say you have individual one with the following attributes:
{age: 25, gender: Male, education: Bachelor's, residence: California, salary: 65,000}.
Individual two has the following attributes:
{age: 27, ...
- 111
0
votes
0
answers
29
views
Should I aggregate explanatory variable?
The dataset I have is
an aggregated outcome, e.g., the quarterly revenue of each firm (that manages a number of plants), revenue is measured by the end of each quarter
a focal explanatory variable, e....
- 117
0
votes
0
answers
457
views
Co-relation between non numeric and numeric variable
I am not good at stats. So accept my apology in advance if my question sounds silly or trivial.
I have two data sets. One contains the positive reviews of the app which includes rating given by the ...
- 143
0
votes
0
answers
32
views
Calculation of Correlation Matrix
If we have continuoues variables $X_{1},X_{2}$ and categorical variables $C_{1},C_{2}$ (with $L+1$ levels each $C_{i}$) variables, how do we define a Correlation Matrix where we have independence ...
- 2,150
1
vote
2
answers
2k
views
Treat year as a fixed effect, random effect, or covariate?
I have a dataset of fish species from different sites within a harbour collected over 17 years. The dataset consists of 1,042 sampling transects collected at 6 specific locations where fish were ...
- 147
0
votes
1
answer
170
views
Can machine learning be used with data where each dimension is different?
Let's suppose that I have some data, and I have a vector representation of each data point. For example, one data point might look like this: [0, 1, 0, 3, -2, 2.3]. Now suppose that for each vector, ...
- 103
1
vote
0
answers
331
views
Testing for Collinearity in a Dataset with Categorical and Continuous Variables
I have a dataset that has 17 variables. 9 categorical and 8 continuous. Some have more than 2 levels. I've reduced the dimensionality significantly. I am looking for strategies to test for colinearity ...
- 111
5
votes
2
answers
2k
views
Why is betareg() giving "invalid dependent variable" error?
I am trying to run a beta regression using the betareg package and I am using the following script:
...
- 733
4
votes
0
answers
82
views
This mixed-type family of random variables has no dominating measure, so a likelihood function can't be defined?
Let
$$ X = \begin{cases}\theta & \text{with probability 1/2}\\ Z\sim N(0,1) & \text{with probability 1/2.} \end{cases}$$
Here, $\theta\in\mathbb{R}$ is the parameter to be estimated. It ...
- 141
1
vote
1
answer
212
views
What is a natural way to define RKHS over mixed spaces (discrete and continuous)?
It is well known that given a kernel $k$ over any space $\mathcal{X}$, there is a corresponding RKHS (Reproducing Kernel Hilbert Space) associated with the kernel $k$. For example, Radial basis ...
- 365
1
vote
0
answers
40
views
Categorical x continuous variable interaction in regression?
I have a sample containing two subgroups and I would like to measure the relationship between two continuous variables across the entire group and check if there's an interaction with subgroup.
First, ...
1
vote
0
answers
492
views
What is the difference between a factorial analysis for mixed data (FAMD) and a PCA on a dataset where qualitative variable are dummy-encoded?
There are many variants of the principal component analysis (PCA) framework for discrete variables or a mixture of quantitative and discrete variables.
Image from this book.
However, I am not ...
- 161
1
vote
0
answers
274
views
Robust RM ANOVA [closed]
I am an R beginner and I needed to run robust two way mixed ANOVAs with R using the WRS2 package and the function btwin because my data has nonnormal residuals (I looked at Q-Q plots) and there is a ...
- 11
0
votes
0
answers
61
views
Factor analysis when I have mixture of continuous and dichotomous variables
I am trying to determine if there is a significant difference between two groups for a single continuous variable while accounting for baseline differences in dichotomous variables in each group.
To ...
2
votes
1
answer
2k
views
What post-hoc test should be used for a glmer model with a binary response, and a continuous and categorical predictor?
I'm a bit of a newbie with stats and R, so need a bit of direction to find a suitable post-hoc test for my glmer model. I'm trying to find if presence is affected by environmental factors for each ...
- 21
0
votes
1
answer
1k
views
PCR after PCA with mixed data - how to extract/export the PCs as new variables in R?
As the title/question implies I ran a PCA with mixed data, i.e. categorical and numeric, in R, once with the "FactoMineR" and "factoextra" packages (analysis version 1) and once with the "PCAmixdata" ...
1
vote
0
answers
40
views
Scaling for mixed data and reverse transform
I have mixed type data (numerical, one hot encoded, ordinal). My data also has outliers. I am trying to scale them using a StandardScaler from sklearn, but I also need to revese transform the test ...
- 77
0
votes
0
answers
122
views
Self organized maps on mixed dataset (categoricals / numerics features )
i have a dataset of mixed variables and i want to apply self organized maps on it
how can i extend som to mixed dataset?
can i use the gower distance instead of euclidienne distance in order to ...
0
votes
0
answers
111
views
How to prove properties about mixed (discrete and continuous inputs) function spaces?
I am using Gaussian Processes for data with mixed inputs (discrete and continuous input variables) i.e. $𝑥=[𝑥_𝑐,𝑥_𝑑]$ where $𝑥_𝑐 \in \Re$ and $x_d \in \mathbb{Z}$. There is a lot of work on ...
- 365
1
vote
0
answers
654
views
How to use filter-based feature selection for mixed data types?
The idea behind filter-based methods of feature selection is that we assign a value to each feature, where the value indicates how important the feature is for predicting the outcome variable. We can ...
- 47
1
vote
1
answer
318
views
Two way ANOVA when one independant variable is not Categorical
I am doing a test on doctors' training level and the number on duty. One IV is training level, the other IV is the number of doctors on duty. The DV is the number of patients seen.
There are two ...
2
votes
1
answer
951
views
Mixture model on binary + continuous data
If I have a dataset of continuous variables (that I can assume are normally distributed), I can identify subgroups using a Gaussian mixture model and implement.
Likewise if I have binary data I can ...
- 688
0
votes
0
answers
37
views
Clustering algorithm for mixed data with non constant categorical variables
I have the following scenario, imagine that I have a dataset as follows:
...
- 111
1
vote
2
answers
289
views
Statistical test to find association between two variables
I'm dealing with ecological data. Broadly speaking, i've counted the plant abundance (discrete variable) in a number of points (small blocks,one number for each ...
- 439
1
vote
0
answers
485
views
Input data for Canonical Correspondence Analysis (CCA)
I'm going to conduct Canonical Correspondence Analysis (CCA). In the tutorial I've found at: CCA
environmental data are discrete ...
- 439
1
vote
2
answers
87
views
Determination of statistically relevant quantitative/qualitative variables
I have a database containing records of several parameters: one is a quantitative parameter $D$ (e.g. average fuel consumption), others are qualtitative parameters $X_1, ..., X_n$ (e.g. make, color, ...
- 31
0
votes
0
answers
76
views
Assessing a binary decission based on continuos and multi-level categorical variables
I have been asked to generate a tool to assess if a particular new set of measurements fit within a list of already accepted ones. The problem is that there are different categorical variables with ...
- 11
0
votes
0
answers
546
views
Need PCA or other dimensionality reduction with mixed type variables, before doing clustering
I have a fairly large dataset of 171 mixed variables (104 dichotomous/qualitative, and 67 continuous). My goal is to build a typology of agricultural systems.
I originally used a PCA to reduce the ...
- 11
2
votes
0
answers
347
views
How to adjust continuous and categorical variables for categorical variable?
I am performing a metaanalysis where I am trying to find predictors for an ordinal response variable. Additionally, I want to perform pair-wise correlations on some of the variables. I have a ...
- 21
3
votes
1
answer
583
views
Bayesian logistic regression: mixed categorical and continuous predictors
I'm trying to model the probability of an event Y based on three independant variables, one (X) is continuous (a log count) and the others (A and B) are categorical (nominal). B is a subcategory of A. ...
- 393
12
votes
1
answer
7k
views
t-SNE with mixed continuous and binary variables
I am currently investigating the visualisation of high-dimensional data using t-SNE. I have some data with mixed binary and continuous variables and the data appears to cluster the binary data much ...
- 223
1
vote
1
answer
2k
views
How to validate clusters after calculating Gower distances and Ward's clustering in R
I am trying to apply Ward's clustering on a mixed types dataset, and wanna explain what I did (maybe helpful to others), and I have some questions regarding this analysis, mainly how to validate my ...
- 11
2
votes
1
answer
212
views
Why does Random Forest not find this simple categorical interaction?
The questions: Why is Random Forest not better at finding an interaction of a simple indicator $\times$ continuous variable? What kind of machine learning model would be better at finding this ...
- 441