Skip to main content

Questions tagged [partitioning]

A partition is an assignment of every element of a set into 1 & only 1 subset w/ no empty subsets. A common instance of partitioning in statistics is the partitioning of sums of squares for F-tests.

Filter by
Sorted by
Tagged with
0 votes
0 answers
22 views

Seeking Lower Bound for Partition Probability in Random Variable Analysis

I am reaching out to seek assistance with a probability problem involving random variables. For each $p$ in $[1,\infty)$, consider positive random variables $X_{1,p}, X_{2,p}, \ldots, X_{n,p}$ such ...
Diego Fonseca's user avatar
0 votes
0 answers
23 views

a continuous analog for adjusted mutual information

I'm interested in comparing a set of electoral redistricting plans to, which can be conceived as partitions of an area. A measure like mutual information looks attractive. Let $U_i$ be a district from ...
fgregg's user avatar
  • 1,200
2 votes
2 answers
74 views

Variance partitioning with crossed and nested factors: A simulation study

I'm working on a variance partitioning study, where I've simulated a dataset with crossed and nested factors. I have three predictor variables and one response variable. The first predictor is crossed ...
Diego Pujoni's user avatar
2 votes
1 answer
45 views

R glmertree: right variables for components? limit patitioning layers? adjust plot? result interpretion?

As a very beginner user, I have the following questions during my testing: 1. What are the suitable variables in the dataset for each of the components on the right side of the below tree formula? <...
nill's user avatar
  • 43
2 votes
1 answer
68 views

MBRP(model based recursive partitioning) with R "glmertree" got error "subscript out of bounds, not all 'rhs' available" [closed]

Originally I ran multilevel regression on to exam how social network properties (SNPs) (e.g. degree, centralities, group size, group centralizations ...) affect individual's productivity outcome. Now ...
nill's user avatar
  • 43
1 vote
1 answer
106 views

Pair confusion matrix for more than two cluster algorithms

How would one code the following issue: The columns represent the k groupings from the k cluster algorithms. The rows are the N(N-1)/2 pairs of data points. If an algorithm groups a pair together (i,j)...
Sean_TBI_Research's user avatar
1 vote
1 answer
109 views

Find p-values from varpart table in vegan package

I have conducted a variance partitioning in R with the vegan package to test how weather variables partition in the variance of the green-up day. ...
Thomas's user avatar
  • 528
0 votes
1 answer
212 views

Annihilator matrix transforming all variables in deviations from their sample means?

In my econometrics notes (not a proper textbook) I find that given a partitioning of the sample matrix X into $$ X =(X_1 1),$$ where 1 is the (nx1) vector of all unity elements, then $$M_{[1]}=I - 1(1'...
ahmaquindi's user avatar
0 votes
0 answers
127 views

Multicollinearity in polynomial regression in R

I fit a model to my data with the following formula after a stepwise selection (x1 to x5 stand for my variables): lm(formula = outcome ~ x1+ x3 + x4 + x2+ x5+ poly(x4, 2) + poly(x2, 2) + poly(x5, 2) + ...
Rossi's user avatar
  • 1
0 votes
1 answer
59 views

Partitioning survival data into prognostic groups

I have survival data (n ~ 1000) with ~40% censoring and ~10% missing data. I want to partition the subjects into 4 prognostic groups based on survival. Misganow B and Vidyasagar M (Exploiting Ordinal ...
Snehal Patel's user avatar
1 vote
1 answer
21 views

How choose the number of classes of a series?

I am newbie in DS. I'm doing a choropleth map with votes of a senator in several cities. And I have two questions: 1 - How choose the correct number of classes to part the data? At the time im using ...
1 vote
1 answer
61 views

fast distance metric between a new data entry and available clusters of data

Assume we divide a large data set D into m different partitions of data in a distributed learning case, using ...
Ham82's user avatar
  • 125
3 votes
2 answers
544 views

Models for describing cluster change over time

Suppose I have a set of observations encoded as a matrix $X$ whose entries $X_{it} \in \mathcal{C} $ correspond to cluster labels of experimental unit $i$ with repeated measures at time $t$, where $\...
fool's user avatar
  • 2,450
1 vote
0 answers
39 views

Which type of sum of squares corresponds to the partition of variance formula for two-way ANOVA?

Does anyone have a good reference for the formula for type I and type III sum of squares in two-way ANOVA? I learned the following formula for partition of total sum of squares in two-way ANOVA. Is it ...
hehe's user avatar
  • 733
2 votes
0 answers
107 views

Partition a vector into equally sized groups

I have a vector of positive numbers x in R and I want to find a way to partition it into k groups so that all the groups have ...
IceCreamToucan's user avatar
1 vote
1 answer
359 views

Variation partitioning using a large matrix as a predictor

I'm trying to understand the amount of variance explained in a univariate response using multiple community matrices as predictors. The problem is set up as such: I have the measured rate of a process ...
Jacob Weverka's user avatar
3 votes
1 answer
608 views

Should the median intuitively split a dataset into equally sized halves - and should two medians split into equally sized fourths?

I cannot decide if this question is patently silly or actually deep, so figured that makes it a perfect question for Cross Validated. We have a dataset with N ...
Kyle Shank's user avatar
1 vote
1 answer
69 views

How to check whether a partitioning is more balanced?

For example consider the following two partitions that add approximately to 100 percent. Partition 1 : 41% 36% 14% 5% 2% 1% <1% <1% Partition 2 : 82% 10% 4% 3% <1% <1% <1% <1% ...
Hakan Baba's user avatar
7 votes
1 answer
965 views

Sampling uniformly from the set of partitions of a set?

In this blogpost, the writer states "It’s easy to sample uniformly from the set of partitions of a set: you pick a number of bins using an appropriate exponential distribution, then randomly i.i....
iaskdumbstuff's user avatar
0 votes
0 answers
247 views

Clustering a distance matrix with k-medoids

For a symmetric distance matrix that I want to cluster, I performed several cluster algorithms: MDS into k-Means DBSCAN OPTICS k-Medoids (the one I'm having trouble with) Now, I would like to know ...
ale.tenorio's user avatar
2 votes
1 answer
19 views

Bayesian evaluation if partitioning is justified for a dataset

I'd like to comparare whether partitioning of a dataset is justified. The data is categorical with two levels and the fitted parameter is the prevalence of positives for a certain condition in each ...
Bakaburg's user avatar
  • 2,927
4 votes
1 answer
54 views

Learn how to bisect 2d data to arrive at 1d relationships

I want to find a way to fit a series of curves throught 2d data. I have a hypothsis of how this can be done (I will explain it below). I would appreciate if anyone could suggest whether this technique ...
Cryo's user avatar
  • 656
1 vote
1 answer
17 views

A line through the origin that bounds a proportion of points in a scatterplot

Suppose I have a scatterplot in a box with 0 < x < x1 and y1 < y < y2. Let 0 < prp < 1. Is there an efficient way to find a line that passes through the origin, and that has prp ...
Argent's user avatar
  • 113
19 votes
3 answers
3k views

Data partitioning for spatial data

I am constructing different configurations of a Random Forest in order to investigate the influence of well-design variables and location, on the first-year production volumes of shale oil wells, ...
veghokstvd's user avatar
4 votes
1 answer
183 views

Exact distribution of number of transitions in a binary vector of length $n$

I am trying to derive an analytic solution for the exact distribution of the number of transitions in a binary vector of length $n$ conditional on the observed number of $1$'s and $0$'s and under the ...
sztal's user avatar
  • 1,191
0 votes
0 answers
461 views

variation partitioning with a GAMM model including an auto-correlation structure in R

I would like to undertake variation partitioning in a GAM framework in R, as described here: https://r.789695.n4.nabble.com/variance-explained-by-each-term-in-a-GAM-td836513.html However, my gam ...
ucfaard's user avatar
  • 43
2 votes
1 answer
176 views

Finding the probability of winning on or before n trials? [closed]

I have two teams A and B, the probability that A wins each hole is p, the probability that B wins each hole is q and the probability that neither wins is r. What is the probability of A winning on or ...
caston1414's user avatar
3 votes
1 answer
228 views

In this concrete example of applying sklearn knn (with kd_tree) on Iris Data Set, how many partitions are there?

The k-nearest neighbors algorithm (k-NN) is a non-parametric method used for classification and regression. In both cases, the input consists of the k closest training examples in the ...
soplus2018's user avatar
1 vote
0 answers
83 views

Recursive partitioning tree vs neural network model

I hope this question helps shed some light on trees vs neural models. I recently came across a model tree, or a recursive partitioning model. It is basically a decision tree that has linear regression ...
ruby's user avatar
  • 41
1 vote
2 answers
1k views

Does the multinomial coefficient create combinations or permutations?

I am looking at this formula I just want to make sure I get it. For example, if I want to split a fifty-two card deck into all the possible combinations of four, thirteen card hands, then I get: $$\...
Cauder's user avatar
  • 337
0 votes
1 answer
321 views

default plot for mob object (glm tree) not returned; using party package [closed]

I'm trying to plot a glm tree using the package party. Per the reference guide, the default plot of the terminal node should be a spinogram as in this image but I ...
ltlf653's user avatar
  • 109
2 votes
1 answer
131 views

Optimization program to allocate time series in 2 groups

I am trying to dispatch $m$ time series into 2 groups. Then I want to sum the value for each time steps, to obtain a sum per group. My goal is to minimize the standard deviation of the difference ...
Romain's user avatar
  • 1,559
0 votes
1 answer
76 views

Statistical test of fairness of partitioning

I have a question about a statistical test, but I lack the proper terminology so I'll try to explain in my own words. Say I have a collection of $N$ objects. The collection is partitioned into $p$ ...
user3414663's user avatar
1 vote
0 answers
138 views

Variation partition analysis: morphology-climate correlation, controlling for geography

I'm working with three datasets with informations about individuals: morphological data, climatic data of the individual sampling site and geographical data. My objective is to assess whether ...
CafféSospeso's user avatar
1 vote
0 answers
40 views

Cluster/partition by time

I have a dataset of different events in time. I want to group/cluster/partition the data by datetime. A small example of the time of the data might be: [19-09-2018 12:00, 19-09-2018 12:01, 19-09-2018 ...
Patrick's user avatar
  • 11
0 votes
1 answer
35 views

Estimation of partitioning error in next-generation sequencing experiments

[Edited: explanation of the partitioning error] I would like to estimate how the initial number of molecules (or the level of gene expression) affects reproducibility between technical replicates of ...
hibernicah's user avatar
0 votes
1 answer
2k views

Adjusted Rand Index with different size inputs

Forgive me if my terminology is off, this concept is somewhat new to me. I'm trying to run an ARI calculation between two partitions which contain a different number of clusters, where each cluster ...
Will Gregory's user avatar
2 votes
1 answer
258 views

Appropriate partition region in a decision tree?

I have the following partition region for a decision tree, but I do not think it is a valid region: $R=(\vec{X}=(X_1, X_2, ..., X_p)^T\in \mathbb{R}^p: X_1X_2 \geq 3)$ I feel that this is not a ...
Shilpa Kancharla's user avatar
4 votes
2 answers
520 views

Predictors in random Forest

I am building a random forest to predict a binary variable y. I have several predictors named x1..n. One predictor, lets say x1, is a very strong predictor of y but only in some cases (see below) ...
MassCorr's user avatar
  • 173
2 votes
0 answers
71 views

Estimates for k-d tree partition cells and for Voronoi partition cells

Let us have a $k$-d tree in a unit cube in ${\mathbb R}^k$. Let the points of the tree in the cube be i.i.d. with some density bounded away from 0. How can I estimate the volumes of partition ...
Viktor's user avatar
  • 1,017
2 votes
1 answer
229 views

How to partition set of items into subsets with similar mean, variance and number of elements - looking for some help

Short version: Given I have a list of 120 traits (happy, sad, etc.) evaluated on a number of scales ranging from -5 (for example highly negative) to +5 (for example highly positive), how can I group ...
blazej's user avatar
  • 547
2 votes
1 answer
731 views

Possible explanations for Imputation before train-test split?

I'm working on a real world data set containing missing information. I understand imputing missing values before data partitioning can lead to leakage of information. I'm using this R package MissMech ...
NoName's user avatar
  • 33
-1 votes
1 answer
109 views

Clustering restaurant dishes

I have data about restaurants, their dishes and customer's orders. Then I want to cluster dishes in restaurant's menu by customer order. So clusters will be dishes in order and criteria of similarity ...
Amelina's user avatar
1 vote
2 answers
137 views

Cluster non-vector data based on similarity rating

I have a list $S$ of $N$ non-vector elements (in this case words or concepts), and I'd like to partition them into k subsets of similar words. For each pair $(a,b)$ with $a,b \in S$, I have a number ...
user1111929's user avatar
0 votes
1 answer
57 views

What statistical methods should i use to identify segments in a population according to a response variable?

Assuming I have $p$ uncorrelated explanatory variables $(X_i)_{i=1...p}$ and one binary response variable $Y$, such that : $$\log\left(\dfrac{P(Y=0|X)}{1-P(Y=0|X)}\right)=1_{\{X_1>0\}}\sum_{i=2}^p\...
R.B's user avatar
  • 11
-1 votes
1 answer
40 views

How is graph clustering performed? [closed]

When we do graph partitioning or graph clustering how does one give the graph as input? Is it by means of an adjacency matrix? What if the graph is very large?
Anuja B.'s user avatar
3 votes
1 answer
1k views

Is it compulsory to partition data in training and testing for time series modelling?

Is it compulsory to partition data in training and testing for time series modelling ? The reason for asking this question: Lets say training data= first 80% observation of actual time series data(...
Abhishek Anand's user avatar
1 vote
0 answers
55 views

Smart sampling to learn a space partitioning

Given a compact feature space, I want to partition the space according to some classification. The first method that comes to mind is to use SVMs. For the classification I have in mind, the space ...
Arthelais's user avatar
  • 111
0 votes
0 answers
78 views

Valid to supply unique features to each fold of k-fold Cross Validation?

I have a dataset of n = 55 samples with 300,000 - 600,000 features for each sample. I am trying to train a model (ksvm classification) to predict the class of each sample. N = 26 of the samples are ...
Reilstein's user avatar
  • 225
2 votes
1 answer
2k views

Partitioning with cross validation?

I am new to data analytics having only started exploring the field this week. I have downloaded KNIME and am working with a single dataset to try out different classification algorithms. I am ...
newDM2's user avatar
  • 21