Questions tagged [representative]
The representative tag has no usage guidance.
62 questions
1
vote
1
answer
65
views
Correcting the results of opinion poll done on unrepresentative sample
An opinion poll should be done on a representative sample of the population, so that its outcomes give a reliable estimate of the real public opinion.
Suppose I have a large database of users, who are ...
- 1,009
0
votes
0
answers
141
views
How to construct homogeneous subsets table for nonparametric tests?
Does post-hoc for friedman tests or nonparametric testshave like a homogeneous subset table from SPSS? Mean doesn't represent it well so I tried using median but my data was zero-inflated so the most ...
- 314
0
votes
0
answers
31
views
How to test that a sample of a discrete random variable is representative?
I am given a discrete random variable and several large samples from it. The methods how the samples are obtained are not truly random samples but are reasonable approximations to a random sample.
An ...
- 498
1
vote
0
answers
84
views
How to create representative training, validation, and test sets when working with time series data?
In my application, I am working with a relatively long time series of daily market index percentage returns (many years) and am trying to model the dependence structure of the returns from a pure time ...
- 451
0
votes
1
answer
32
views
Nonrepresentative sample for causal analysis
Suppose I observe an outcome $Y_i$ for a binary policy $Z_i$ with random assignment and no spillovers such that $Y_i(1),Y_i(0) \perp Z_i$. I run the regression
$$
y_i = \alpha + \beta z_i + \...
- 363
2
votes
1
answer
46
views
Can I CUT a sample to become representative?
Suppose that, from a finite population, we estimated the minimum sample size as 1000 to reach our desired confidence level and error.
Data was collected using an online survey and the survey remained ...
- 439
1
vote
1
answer
108
views
Training a classifier on a highly unbalanced class distribution?
I'm trying to train a text classification model that can predict label $A$ and $B$ accurately. However, 95% of the text examples in my dataset, which is representative of the kind of data I want my ...
- 33
0
votes
0
answers
194
views
Creating a representative sample
I'd like to create a representative sample from a larger population for monitoring (a hold-out control). I've thought of three approaches and am trying to select between them (plus I'm open to others)...
- 46
1
vote
1
answer
31
views
How to sample for compliance when a portion of the population is already known to be non-compliant?
Say I wanted a representative sample to estimate the portion of a population that is compliant on "doing their taxes correctly". Normally, I'd do a random sample of that population to make ...
- 315
1
vote
2
answers
63
views
How to validate representativeness of survey on new social group?
Say a new social group X emerges in society. Say you take a sample from individuals in this group X. How to validate the sample's representativeness?
For samples of other parts of society, you have a ...
- 2,746
4
votes
2
answers
430
views
Should folds in k-fold CV actually be representative?
I have read somewhere that the k of the k-fold CV should be picked in such a manner as to have representative validation sets (folds). This seems to me to be contradictory since the leave-one-out CV ...
- 63
2
votes
0
answers
74
views
Draw a stratified sample in panel data
Question: How can we draw a stratified sample in panel data context when the stratifying variables are not fixed over time?
Background: I have panel data on workers (id) over time (t). I want to draw ...
- 363
4
votes
0
answers
246
views
How can you evaluate the representativeness of a sample for a given distribution?
Problem:
I am looking for a metric to find the representativeness of a sample for a given distribution, being the representativeness of a random sample as the degree of capacity of the sample to ...
- 41
1
vote
1
answer
57
views
Representative Observation and Random sampling
Suppose that we have a cross-sectional data set drawn by random sampling.
Then, the data may represent our population of interests.
We can consider two subpopulations: male group and female group.
...
- 945
0
votes
0
answers
79
views
When analyzing national surveys, do I always weight the answers with the expansion factor to get represenative results?
When analyzing national surveys, do I always weigh the answers with the expansion factor to get represenative results?
Alternatively, would it be wrong to just "weigh" each answer with 1 and ...
1
vote
0
answers
88
views
When we up-sample the training set, don't we introduce selection bias?
When doing supervised machine learning in the health or medical domains, we often have a target class that is relatively rare (e.g., prevalence 1-10% of cases). There are a few techniques we can do to ...
- 11
0
votes
0
answers
24
views
Theory related to choosing high-information representative samples of a distribution
Let $X$ be a random variable of human height and suppose that $X$ is normally distributed.
If our goal is to select 'representatives' of the concept 'height', a reasonable way to choose representative ...
- 131
1
vote
0
answers
61
views
How to compare sample and population characteristics?
I have a sample $S1$ of 200 people, and I obtained a subsample $S2$ of 100 people by emailing a survey link to $S1$. So, $S2$ is a nonrandom subsample drawn without replacement.
In the sample $S1$, I ...
- 187
0
votes
0
answers
124
views
Time dependent representation for time series events with different time gaps?
In natural language processing, we can treat characters as evenly spaced time series in RNN models where time gaps are independent of the sequence and only sequential positions matter.
If I want to ...
- 6,912
1
vote
0
answers
32
views
Is there any appropriate technique to look for a continuous, representative part of a time series dataset?
I would like to know if there is any machine learning technique that could be used to solve the problem as follows. Imagine a time series dataset with several rows (observations) and many columns (...
- 11
1
vote
0
answers
107
views
Finding the "most representative" variables of a population
Most polls use the so-called quotas method to obtain their sample. They draw candidates upon a large panel of people and add one-by-one each responding candidate to the sample unless a certain quota ...
- 83
7
votes
3
answers
2k
views
How to make sure that the random sample is representative for the whole sample?
I have 14k tweets and I want to code these tweets (categorize them based on their topics), but since it is difficult to do the coding for the whole dataset, I decided to take a sample from it.
What I ...
- 71
1
vote
1
answer
148
views
Select a sample size form the infinite population
I have a list of every store chain in the US with at least 100 locations in the US.
a) What number of those do I have to pick in order to have a representative sample of the number of locations across ...
0
votes
1
answer
533
views
Algorithm to get representative sample
For a dataset I wanted to pick-out some most representative points from it. Lets say the first point could be centroid, next could be the one farthest from it in the data-set(To get variance in data) &...
- 35
1
vote
1
answer
487
views
How to partition a sample into representative subsamples?
The problem is the following: take a sample $X$ of the general population $\Omega$. Each element of $\Omega$ (and hence, each element of $X$) is described by a vector of characteristics, each ...
- 83
1
vote
0
answers
111
views
How to assess geographical representativity of a sub-area? [closed]
My geographical zone $A$ is subdivided in $k$ different types of areas: $A_1 + A_2 + \dots{} + A_k = A$. These have been measured on a map with neglictible uncertainty: i.e. for any point on the map, ...
- 143
1
vote
0
answers
60
views
Representativeness of sample, distribution of age from sample compared to national sample
Please forgive my entry-level question. I have been slamming my head on the table for well over 3 hours now as I cannot seem to figure this one out.
I have a sample of n=450, population is about 17m....
- 11
0
votes
0
answers
23
views
Choosing data to compare collected data against
I currently have a sample of 30 data points of how long a specific process takes to complete when a particular issue occurs and am looking to compare these times to the times where it doesn't happen ...
- 1
1
vote
0
answers
51
views
Can I use a stratified random sample to avoid getting a random sample that is clearly not representative?
This is a follow-up to a question of what to do if you get a sample that is clearly not representative [What if your random sample is clearly not representative? ]
I have a population of 800 in 25 ...
- 3,427
2
votes
2
answers
1k
views
Evaluate Sample Representativeness of Dataset
I'm trying to check / evaluate how representative a sample is from a dataset.
I'm interested in two things:
Which sample best represents the original dataset
Is the sample a "good enough" ...
- 203
2
votes
1
answer
61
views
What is the ideal population size so that its median is a representative statistical measure? [closed]
I am perfoming a robust z-score analysis to remove trends of temporal evolution of a certain variable so that I can compare different years.
It is robust because there are outliers.
My data is ...
- 65
0
votes
1
answer
3k
views
How to check if a sample is representative of a population, across several criteria.
I have a total population of several hundred houses, which have different sizes, prices, and ages.
I want to be able to select a random sample, of a few dozen or so houses, and test how ...
1
vote
0
answers
62
views
Representative sample
My question is about representative samples. My population is parents of children attending public autism-specific schools. I distributed paper-based questionnaires to all the parents in the public ...
- 11
1
vote
0
answers
276
views
Raking to converting a convenience sample to representative sample
I have a convenience sample of patients in a ZIP Code Tabulation Area (ZCTA) for whom I know their gender and age.
I also have census data for the ZCTA (in particular I have 1) the percentage of ...
- 803
1
vote
0
answers
201
views
Relation between representativeness of a sample and sample size
Is there a relation between sample size and a representative sample? Does the sample size affect the representativeness of a sample?
Context: I used cluster sampling to get a sample of the study ...
- 171
1
vote
0
answers
60
views
Sample size calculation of a national study
We want to conduct a national study to estimate a prevalence of certain disease. we still confused about the sample size calculation and the criteria of selecting a representative sample.
First: is ...
- 107
2
votes
1
answer
122
views
How do I estimate error when I know a survey is not representative?
Let's say that I have a survey of $n = 1000$ respondents from a population of $N = 3000$.
Moreover, it is known that the ratio of male to female in the population is $50:50$. However, in the sample, $...
user64106
0
votes
0
answers
42
views
Representative Sample - Air travel passengers and gender ratio
I have a question regarding the ways to build a representative sample for a research study focusing on air travel passengers in 3 different world regions (NA, EMEA, APAC)
I think I should use the ...
- 11
0
votes
0
answers
59
views
How can one control variables but ensure that the population is representative?
Usually, you want to control variables within a study. However, you also want to obtain a representative population to the population that you're measuring. How can one even strike a balance between ...
- 173
1
vote
2
answers
449
views
Questions on population and sample
As someone new to statistics, I had a debate with my supervisor today on the definition of population and sample in the following case.
Suppose we track all new users (1,000 in total) that used an ...
- 13
1
vote
0
answers
66
views
Proper way to determine that one sample is better (more representative of a known population) than another sample
Please excuse me if this has been asked before, I searched and couldn't find what I was looking for. The basic setup of my question is this - I have data on all of the students for a school. I then ...
- 11
1
vote
0
answers
41
views
Deciding by RMSE how many simulation results to use for a representative sample
So, I'm doing a brute force Monte Carlo simulation to vary certain parameters and running a model through a thermal computational test bed. At the end I get temperatures for every hour. We have ...
0
votes
1
answer
610
views
What type of MDS (Multidimensional Scaling) algorithm should I used?
Dataset for User-Page view, which represent in matrix, rows are Users (2000+ or more) and columns ( Pages may be 100+),entries represent frequency(number of time user visit that page), I would like to ...
- 19
1
vote
1
answer
227
views
How can I calculate when a text corpus is representative of a language?
I am collecting and analyzing articles and other publications for building a text corpus.
I'd like to know how to calculate when my text corpus is representative of a field. That is, how many texts, ...
0
votes
1
answer
74
views
How to best represent a geographical area as point
I need to check a relationship(?) between land surface temperature (LST) and total population census tract (shapefile) wise where i am trying to relate social factors (e.g. total population, female ...
- 113
1
vote
1
answer
92
views
Data management of a representative sample
In our original database there are some variables which are quantitative, but actually they are categorical variables. Our question is, should categorization be done in the original database or ...
- 681
1
vote
1
answer
90
views
Sample Representing a Different Population
I have two sets of populations: containing 1.5 million and 5.5 million units. I need to select a sample out of 5.5 million population so that the sample represents the 1.5 million population based on ...
2
votes
1
answer
490
views
Conceptual definition between randomness, representativeness and bias in sampling
I was wondering if you can help me clarifying some concepts (if it is possible providing references to papers or books) that I will write in the form of ideas rather than questions.
Consider this ...
- 173
3
votes
1
answer
258
views
Representative resampling
I am working with a population in which each individual has, among others, 6 observed variables that can be 0 or 1: $X_i \sim Bernoulli(p_i),\ i=1,...,6$ . I know the "true" value for the ...
- 133
0
votes
1
answer
166
views
How to calculate the randomness of a sample and if it is representative on r?
I am doing a project on R commander and the project says, "The set of exoplanets discovered to this day is a sample of all exoplanets that exist in the universe. Discuss whether you think this sample ...
