Skip to main content

Questions tagged [subset]

One set, A, is a subset of another, B, if and only if all elements of A are elements of B.

Filter by
Sorted by
Tagged with
2 votes
0 answers
16 views

Performing PCA with results of multiple other PCAs? Is this legit, how do I interpret it?

I'm a biology researcher, working on a manuscript that involves folks from outside of my discipline. They are using PCA to create indices of demographic variables, to categorize geographic areas. For ...
Jas Max's user avatar
  • 848
1 vote
1 answer
29 views

How can I interpret non-significance in models built with subsetted data?

I am working on revisions, and it was requested that I re-run my models separately for males and females. When I do this, I lose statistical significance in some tests in females but not in males, but ...
HarD's user avatar
  • 227
0 votes
0 answers
70 views

How to calculate confidence intervals in a subgroup of a weighted sample?

I have a weighted data sample (size : 20000) and I want to calculate a 95% confidence interval for the mean of a variable in the dataset, but only in a specific subgroup within this dataset (size of ...
mtr's user avatar
  • 1
0 votes
0 answers
51 views

Subgroups comparison

I have to compare two subgroups from the same population. The two groups have partially the same records, so they are overlapping subsets of the same dataset. Can I consider them as two independent ...
ArTu's user avatar
  • 213
1 vote
0 answers
25 views

Convergence of a subsequence of arrays of random variables

Consider $X(ij)$ for $i = 1, ..., n$ and $j = 1, ...,n$ be random variables. I proved that for each i, the sequences $X($i$j)$ converge in distribution to random variable Y as $n$ tends to $\infty$. ...
Eryna's user avatar
  • 329
1 vote
0 answers
16 views

Does anyone know how to model selection for function on function linear model to find the best subset of functional covariate in R [closed]

Does anyone know how to model selection for function on function linear model to find the best subset of functional covariate in R
Sky Sha's user avatar
  • 11
4 votes
3 answers
465 views

Why is the number of subsets in a sample space $2^n$?

I am working my way through the statistical inference textbook and am stuck on this question: Suppose that a sample space $S$ has $n$ elements. Prove that the number of subsets that can be formed ...
Solal's user avatar
  • 71
0 votes
1 answer
107 views

Following Pearson correlation analysis how to compare subsets of the significant correlations

How can I statistically compare subsets of the significant correlations produced from Pearson correlation analysis (r-value, p-value) and Benjamini-Hochberg multiple testing adjustment (q-value)? To ...
Buzz B's user avatar
  • 1
1 vote
1 answer
814 views

Inconsistent handling of lonely PSUs in R's `survey` package?

There appears to be some inconsistent handling of lonely PSUs in R's survey package when calling svyglm on a subset of ...
Eric's user avatar
  • 13
1 vote
1 answer
93 views

interaction term in Cox PH model

I have a question with regard to interaction term in Cox PH model. I'd like to analyze the impact of variable A on cardiovascular (CV) event. Variable A levels are different according to sex, although ...
doyle's user avatar
  • 11
2 votes
0 answers
278 views

Discordant results using IPW and overlap weights (propensity score approach) in sub-group analyses

I am investigating the effect of a treatment on the risk of a disease (% disease=18.5% (515/2784)). To do so, I use a propensity score (PS) approach with two different weights methods: IPW (stabilized ...
Simon Nusinovici's user avatar
0 votes
0 answers
74 views

Model comparison on different datasets + Non-nested model comparison

I actually have two questions. Similar questions unfortunatelly do not answer mine. 1)I realize that with anova(model1,model2) one can only compare two models if ...
lubalubalubakit's user avatar
0 votes
0 answers
89 views

Should I use AIC / BIC or rather cross validation for discovering gov. equations through linear regression (SINDy)?

I want to use linear regression with very large design matrix for discovery of governing equations to i.e. physical systems. The design matrix would include potential terms that can be part of the ...
Timo's user avatar
  • 11
2 votes
1 answer
144 views

Linear Regression - Data Subset with Lowest Mean-Squared Error?

Short version: given a linear regression dataset and an integer $K$, what data subset of size $K$ results in linear parameters with the lowest mean squared error on the entire dataset? Long version: ...
Rylan Schaeffer's user avatar
0 votes
1 answer
23 views

Determine the likelihood of occurrence of an activity within a subset

I have a monitor that measures dust concentrations around our neighborhood, and from this dataset I subset it into three scenarios to see which scenarios create the most dust. However, when I do this, ...
HongH378's user avatar
2 votes
1 answer
460 views

When is subsetting survey data prior to analysis NOT a problem?

Survey researchers are typically advised to not subset their data prior to analysis because it will produce incorrect variance estimates. My understanding of the inferential issue is that removing ...
socialscientist's user avatar
0 votes
0 answers
19 views

Compare models from different data subsets [duplicate]

I'm looking to compare linear regression models from different data subsets in r. The models are not nested. I have a model from the complete dataset with sex as a factor and then 2 separate models ...
Moogle's user avatar
  • 31
4 votes
2 answers
690 views

Is it preferable to subset data to test specific hypotheses or specify a full model and run contrasts?

Let's say I have a 2x2 design where participants are either in condition A or condition B and, within each condition, either get exposed to exposure C or exposure D. First, I want to test whether ...
Parseltongue's user avatar
  • 1,030
0 votes
1 answer
63 views

Logistic regression balanced dataset

I am quite inexperienced using logistic regression and am having trouble understanding my data and how the regression behaves. Here's the outline of my problem: I have a (medical) test that gives a ...
MyLion's user avatar
  • 3
7 votes
1 answer
133 views

Is there a name for the increase in variance upon remeasurement after subsetting with a cut-off value?

Context: My problem relates to estimating effect sizes, such as Cohen's d, when looking at a subset of the population defined by a cut-off threshold. This effect size is the difference in two ...
David L Thiessen's user avatar
1 vote
0 answers
42 views

How to treat apples and oranges best in multiple regression analysis? One fits all regression model or separate sub models? [duplicate]

I have a data set ready for multiple regression analysis that consist of apples and oranges. Let's say the depended variable is fruit size and there is a bunch of independent variables (categorical &...
MsGISRocker's user avatar
3 votes
2 answers
46 views

Relationship between deterministc function of random variables

Given a discrete $P(X,Y,Z)$ let's call $\Omega$ the set of all deterministic functions $f: XYZ \rightarrow W$ and $\Omega'$ the set of all deterministic functions $f': XY \rightarrow V$. Is it correct ...
Cesare's user avatar
  • 667
0 votes
1 answer
33 views

How to isolate a linearly correlating subset from data?

I have a data set of a few thousand data points, and some of them show strong linear correlation. I would like to isolate these data points into their own subsets. What would be the best approach for ...
Hessu's user avatar
  • 11
0 votes
0 answers
148 views

Difference between stratification and subset

This may be a duplicate question asked differently, I am curious to know the difference between performing an analysis by stratification on a variable and by subsetting the dataset based on that ...
Emily Fassbender's user avatar
4 votes
1 answer
998 views

Probability problem - Probability to pick a subset divisible by 3

I'm trying to solve this puzzle but I get stuck. I thought about trying to use the law of total probability to solve intermediate problems with subset of size k but it didn't helped me that much. Is ...
Meliodas's user avatar
1 vote
1 answer
30 views

Unsupervised Subspace learning for different Tasks

once we extract subspaces(subset of features) for a dataset using unsupervised learning, can we use them for any task I mean for classification, clustering, or outlier detection? Is the selection of ...
SS Varshini's user avatar
2 votes
1 answer
389 views

What is it called when we "zoom in" a data distribution?

Suppose we have a 2D distribution of shops in an area. For example, here is a heatmap density plot of (latitude, longitude) location of shops in a province: Now suppose that we "zoom into" the ...
Ali's user avatar
  • 318
3 votes
0 answers
238 views

Is it appropriate to include overlapping sub-scale scores and total-scale scores in a meta-analysis?

Question, brief In a single multi-level meta-analysis, is it appropriate to include subscale scores (which represent part of a measure) in addition to total scale scores (representing the full ...
Betsy S.'s user avatar
  • 363
1 vote
0 answers
569 views

Q: AUC of each subgroup is smaller than overall AUC

I have a validation data set of 29242 patients, with known labels/health outcomes and predictions that were generated by some model. 28626 patients are negative and 616 are positive The overall AUC is ...
Yossi Levy's user avatar
5 votes
2 answers
851 views

How to test that a subset of data is distributed no differently than original (discrete, not normal)

In the research I am doing, we have initially had ~600 samples which had a certain distribution (not normal, although close). The characteristic of these samples that I am interested in is discrete (...
xXthruXx's user avatar
0 votes
1 answer
54 views

Compact encoding (vectorization) of unbounded sets

Question I have a set of sets. Each set is unbounded. I would like to find a methodology to encode (vectorize) each subset. I am more specifically interested in memory efficient solutions. ...
nmc's user avatar
  • 137
2 votes
2 answers
2k views

Determine how similar groups of data are to each other

I have a pool of 15,000 unique* items. From that set, there are roughly 3200 sets of 60 items, selected non-randomly (in fact, for the sake of the framing of the question, let's say that each item is ...
John Doe's user avatar
1 vote
1 answer
16 views

Inferential considerations when comparing a group against the total

I want to compare the value of a subgroup against the same value in the total population in a regression setting. The easiest way to do it would be to treat the subgroup and the total dataset as two ...
Bakaburg's user avatar
  • 2,949
11 votes
3 answers
4k views

How to calculate number of sets in Sigma Algebra

The example 1.2.2 of the book Statistical Inference by Casella and Berger states: if S has n elements, there are 2^n sets...(please see attached). Could you please explain how the authors derived ...
Nemo's user avatar
  • 379
0 votes
1 answer
75 views

relation between conditional probability of subset and set

Suppose $A\subseteq B $. Can we derive a relationship between P(X|A) and P(X|B) for some X? X is associated with A.
Nilay Thakor's user avatar
3 votes
2 answers
388 views

Why do subset selection linear models have higher variance than the full model?

I do not get the meaning of this sentences from the Elements of Statistical Learning book when talking about subset selection methods before introducing shrinkage methods. By retaining a subset of ...
Francesco Boi's user avatar
1 vote
0 answers
27 views

L sets and Probability theory

I am required to prove the following: Let $L_1$ be the space of real-valued random variables on $(\Omega,\mathscr{A},\mathbb{P})$ which have finite expectation $\mathbb{E}(|X|)<\infty$ and let $...
Devi's user avatar
  • 11
0 votes
0 answers
183 views

Problem with significance of results from regression on subset of data

I have performed a hedonic regression with a database where all the variables are very significant and according to the calculations made in R with a squared R = 0.6123. I have performed the same ...
Ricardo T.'s user avatar
0 votes
0 answers
34 views

Represent roles intersections

I have 11 roles, who defines rights (read, edit, write) on my application. For exemple I have "Inventory" who contains ressources_read and ...
Iraponti's user avatar
0 votes
1 answer
1k views

What statistical distribution test to use for comparing Dataset and its subset? [duplicate]

I have two sets, A and B ,containing height of students. Set A contains height of all students in the class and Set B contains height of some students from the same class. Hence, Set B is a subset of ...
Kavi Pandya's user avatar
0 votes
1 answer
35 views

Which is the event, sample and population, notation confusion

I am really struggling with the notation for this. Below is the slide material followed by what I think it means/where I get stuck. "Some unknown real world quantity $\Theta$ takes values in $\Omega$....
BlueTurtle's user avatar
0 votes
0 answers
41 views

Determining whether it matters which subset I pick from my dataset

I'm going to simplify my own research problem with the following example: Lets suppose I have N=40 students in my classroom. I need to select 20 of them to participate in a national math competition. ...
brohan322's user avatar
  • 101
0 votes
1 answer
35 views

Resample dataframe by random subset of years

I have a dataset of 59 years worth of daily rainfall data. I'd like to resample the data by 6 randomly selected years 1,000 times, using the entire year of data for each of the 6 years (so 2190 ...
S. Garvis's user avatar
1 vote
0 answers
64 views

Sample subsets with distribution proportional to elementwise product

I have a set of $n$ elements, $x_1,x_2,\dots,x_n$, each with a weight $w_1, w_2,\dots, w_n$. I want to sample a subset of fixed size $k$ such that the probability of drawing $\{x_a,\dots,x_b\}$ is ...
Attila Szabó's user avatar
4 votes
1 answer
419 views

Unsupervised clustering of sequence of events to subsequences

I have a big dataset of M sequences of [1 - N] events, where each event has multiple properties (start date, end date, location, ...
Dimgold's user avatar
  • 318
0 votes
1 answer
122 views

Why is the relationship between max(X,Y) and X and Y the way it is?

My textbook says that the above follows from the observation: $\{W\leq w\}=\{X\leq w\},\{Y\leq w\}$, How do we prove the above observation?
DiamondDust's user avatar
0 votes
1 answer
54 views

Survival analysis with incomplete data

I would like to estimate the association between exposure to an environmental contaminant and all-cause mortality. Unfortunately the dataset I can get access to is incomplete - exposure data are only ...
Gux's user avatar
  • 355
1 vote
0 answers
23 views

k-means and (re?) standardisation of a sub-set

I have data which is customer purchases of items in each of three months: I have summed the data over the three months for each customer; calculated the proportion of purchases that each item ...
Stephen Clark's user avatar
0 votes
1 answer
79 views

Dividing datasets into fully-correlating subsets

I have a dataset of $N$ variables of which I know that (at least) one combination of their disjoint subsets results in non-negative correlation coefficients for all variables in these subsets. The ...
Zollern's user avatar
0 votes
0 answers
150 views

Finding p-value of similarity between 2 networks

So, I want to calculate p-value of a case if possible. Suppose I have: set A with 1,295 elements set B with 493 elements number of same element between set A and B (intersection) is 478 From each ...
Bharata's user avatar
  • 143