Skip to main content

Questions tagged [representative]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
58 views

Correcting the results of opinion poll done on unrepresentative sample

An opinion poll should be done on a representative sample of the population, so that its outcomes give a reliable estimate of the real public opinion. Suppose I have a large database of users, who are ...
Erel Segal-Halevi's user avatar
0 votes
0 answers
83 views

How to construct homogeneous subsets table for nonparametric tests?

Does post-hoc for friedman tests or nonparametric testshave like a homogeneous subset table from SPSS? Mean doesn't represent it well so I tried using median but my data was zero-inflated so the most ...
Derf's user avatar
  • 281
0 votes
0 answers
30 views

How to test that a sample of a discrete random variable is representative?

I am given a discrete random variable and several large samples from it. The methods how the samples are obtained are not truly random samples but are reasonable approximations to a random sample. An ...
quarague's user avatar
  • 490
1 vote
0 answers
75 views

How to create representative training, validation, and test sets when working with time series data?

In my application, I am working with a relatively long time series of daily market index percentage returns (many years) and am trying to model the dependence structure of the returns from a pure time ...
QMath's user avatar
  • 451
0 votes
1 answer
28 views

Nonrepresentative sample for causal analysis

Suppose I observe an outcome $Y_i$ for a binary policy $Z_i$ with random assignment and no spillovers such that $Y_i(1),Y_i(0) \perp Z_i$. I run the regression $$ y_i = \alpha + \beta z_i + \...
Papayapap's user avatar
  • 361
0 votes
0 answers
8 views

How to improve sample representativeness for longitudinal data collected via an online platform?

I am working with a longitudinal dataset exploring cognitive ageing (e.g., memory performance over time). Participants complete the study annually. Inclusion criteria for this study are 1) UK resident,...
Aepkr's user avatar
  • 199
2 votes
1 answer
42 views

Can I CUT a sample to become representative?

Suppose that, from a finite population, we estimated the minimum sample size as 1000 to reach our desired confidence level and error. Data was collected using an online survey and the survey remained ...
Oalvinegro's user avatar
1 vote
1 answer
67 views

Training a classifier on a highly unbalanced class distribution?

I'm trying to train a text classification model that can predict label $A$ and $B$ accurately. However, 95% of the text examples in my dataset, which is representative of the kind of data I want my ...
Sanger Steel's user avatar
0 votes
0 answers
121 views

Creating a representative sample

I'd like to create a representative sample from a larger population for monitoring (a hold-out control). I've thought of three approaches and am trying to select between them (plus I'm open to others)...
corrin's user avatar
  • 46
1 vote
1 answer
29 views

How to sample for compliance when a portion of the population is already known to be non-compliant?

Say I wanted a representative sample to estimate the portion of a population that is compliant on "doing their taxes correctly". Normally, I'd do a random sample of that population to make ...
coip's user avatar
  • 315
1 vote
2 answers
61 views

How to validate representativeness of survey on new social group?

Say a new social group X emerges in society. Say you take a sample from individuals in this group X. How to validate the sample's representativeness? For samples of other parts of society, you have a ...
luchonacho's user avatar
  • 2,752
4 votes
2 answers
395 views

Should folds in k-fold CV actually be representative?

I have read somewhere that the k of the k-fold CV should be picked in such a manner as to have representative validation sets (folds). This seems to me to be contradictory since the leave-one-out CV ...
bob_cart's user avatar
2 votes
0 answers
72 views

Draw a stratified sample in panel data

Question: How can we draw a stratified sample in panel data context when the stratifying variables are not fixed over time? Background: I have panel data on workers (id) over time (t). I want to draw ...
Papayapap's user avatar
  • 361
4 votes
0 answers
232 views

How can you evaluate the representativeness of a sample for a given distribution?

Problem: I am looking for a metric to find the representativeness of a sample for a given distribution, being the representativeness of a random sample as the degree of capacity of the sample to ...
mcardoner's user avatar
1 vote
1 answer
51 views

Representative Observation and Random sampling

Suppose that we have a cross-sectional data set drawn by random sampling. Then, the data may represent our population of interests. We can consider two subpopulations: male group and female group. ...
M.C. Park's user avatar
  • 935
0 votes
0 answers
64 views

When analyzing national surveys, do I always weight the answers with the expansion factor to get represenative results?

When analyzing national surveys, do I always weigh the answers with the expansion factor to get represenative results? Alternatively, would it be wrong to just "weigh" each answer with 1 and ...
peace4world's user avatar
1 vote
0 answers
88 views

When we up-sample the training set, don't we introduce selection bias?

When doing supervised machine learning in the health or medical domains, we often have a target class that is relatively rare (e.g., prevalence 1-10% of cases). There are a few techniques we can do to ...
Julie Kafka's user avatar
0 votes
0 answers
23 views

Theory related to choosing high-information representative samples of a distribution

Let $X$ be a random variable of human height and suppose that $X$ is normally distributed. If our goal is to select 'representatives' of the concept 'height', a reasonable way to choose representative ...
Rubertos's user avatar
  • 131
1 vote
0 answers
55 views

How to compare sample and population characteristics?

I have a sample $S1$ of 200 people, and I obtained a subsample $S2$ of 100 people by emailing a survey link to $S1$. So, $S2$ is a nonrandom subsample drawn without replacement. In the sample $S1$, I ...
SEL's user avatar
  • 187
0 votes
0 answers
119 views

Time dependent representation for time series events with different time gaps?

In natural language processing, we can treat characters as evenly spaced time series in RNN models where time gaps are independent of the sequence and only sequential positions matter. If I want to ...
Lerner Zhang's user avatar
  • 6,728
1 vote
0 answers
32 views

Is there any appropriate technique to look for a continuous, representative part of a time series dataset?

I would like to know if there is any machine learning technique that could be used to solve the problem as follows. Imagine a time series dataset with several rows (observations) and many columns (...
MarlonTieh's user avatar
1 vote
0 answers
92 views

Finding the "most representative" variables of a population

Most polls use the so-called quotas method to obtain their sample. They draw candidates upon a large panel of people and add one-by-one each responding candidate to the sample unless a certain quota ...
bixiou's user avatar
  • 83
7 votes
3 answers
2k views

How to make sure that the random sample is representative for the whole sample?

I have 14k tweets and I want to code these tweets (categorize them based on their topics), but since it is difficult to do the coding for the whole dataset, I decided to take a sample from it. What I ...
Anas's user avatar
  • 71
1 vote
1 answer
143 views

Select a sample size form the infinite population

I have a list of every store chain in the US with at least 100 locations in the US. a) What number of those do I have to pick in order to have a representative sample of the number of locations across ...
Effective Learning's user avatar
0 votes
1 answer
496 views

Algorithm to get representative sample

For a dataset I wanted to pick-out some most representative points from it. Lets say the first point could be centroid, next could be the one farthest from it in the data-set(To get variance in data) &...
Nishant 's user avatar
1 vote
1 answer
438 views

How to partition a sample into representative subsamples?

The problem is the following: take a sample $X$ of the general population $\Omega$. Each element of $\Omega$ (and hence, each element of $X$) is described by a vector of characteristics, each ...
bixiou's user avatar
  • 83
1 vote
0 answers
111 views

How to assess geographical representativity of a sub-area? [closed]

My geographical zone $A$ is subdivided in $k$ different types of areas: $A_1 + A_2 + \dots{} + A_k = A$. These have been measured on a map with neglictible uncertainty: i.e. for any point on the map, ...
iago-lito's user avatar
  • 143
1 vote
0 answers
54 views

Representativeness of sample, distribution of age from sample compared to national sample

Please forgive my entry-level question. I have been slamming my head on the table for well over 3 hours now as I cannot seem to figure this one out. I have a sample of n=450, population is about 17m....
Jay's user avatar
  • 11
0 votes
0 answers
23 views

Choosing data to compare collected data against

I currently have a sample of 30 data points of how long a specific process takes to complete when a particular issue occurs and am looking to compare these times to the times where it doesn't happen ...
mcsstats 's user avatar
1 vote
0 answers
51 views

Can I use a stratified random sample to avoid getting a random sample that is clearly not representative?

This is a follow-up to a question of what to do if you get a sample that is clearly not representative [What if your random sample is clearly not representative? ] I have a population of 800 in 25 ...
Joel W.'s user avatar
  • 3,376
2 votes
2 answers
1k views

Evaluate Sample Representativeness of Dataset

I'm trying to check / evaluate how representative a sample is from a dataset. I'm interested in two things: Which sample best represents the original dataset Is the sample a "good enough" ...
abdnChap's user avatar
  • 203
2 votes
1 answer
59 views

What is the ideal population size so that its median is a representative statistical measure? [closed]

I am perfoming a robust z-score analysis to remove trends of temporal evolution of a certain variable so that I can compare different years. It is robust because there are outliers. My data is ...
Seiji's user avatar
  • 65
0 votes
1 answer
3k views

How to check if a sample is representative of a population, across several criteria.

I have a total population of several hundred houses, which have different sizes, prices, and ages. I want to be able to select a random sample, of a few dozen or so houses, and test how ...
Edward Hampson's user avatar
1 vote
0 answers
62 views

Representative sample

My question is about representative samples. My population is parents of children attending public autism-specific schools. I distributed paper-based questionnaires to all the parents in the public ...
Sumari's user avatar
  • 11
1 vote
0 answers
266 views

Raking to converting a convenience sample to representative sample

I have a convenience sample of patients in a ZIP Code Tabulation Area (ZCTA) for whom I know their gender and age. I also have census data for the ZCTA (in particular I have 1) the percentage of ...
derNincompoop's user avatar
1 vote
0 answers
198 views

Relation between representativeness of a sample and sample size

Is there a relation between sample size and a representative sample? Does the sample size affect the representativeness of a sample? Context: I used cluster sampling to get a sample of the study ...
houneida's user avatar
  • 171
1 vote
0 answers
58 views

Sample size calculation of a national study

We want to conduct a national study to estimate a prevalence of certain disease. we still confused about the sample size calculation and the criteria of selecting a representative sample. First: is ...
Reem M.Al Haj's user avatar
2 votes
1 answer
121 views

How do I estimate error when I know a survey is not representative?

Let's say that I have a survey of $n = 1000$ respondents from a population of $N = 3000$. Moreover, it is known that the ratio of male to female in the population is $50:50$. However, in the sample, $...
user avatar
0 votes
0 answers
40 views

Representative Sample - Air travel passengers and gender ratio

I have a question regarding the ways to build a representative sample for a research study focusing on air travel passengers in 3 different world regions (NA, EMEA, APAC) I think I should use the ...
Mark's user avatar
  • 11
0 votes
0 answers
59 views

How can one control variables but ensure that the population is representative?

Usually, you want to control variables within a study. However, you also want to obtain a representative population to the population that you're measuring. How can one even strike a balance between ...
Mathematician's user avatar
1 vote
2 answers
440 views

Questions on population and sample

As someone new to statistics, I had a debate with my supervisor today on the definition of population and sample in the following case. Suppose we track all new users (1,000 in total) that used an ...
RZY's user avatar
  • 13
1 vote
0 answers
66 views

Proper way to determine that one sample is better (more representative of a known population) than another sample

Please excuse me if this has been asked before, I searched and couldn't find what I was looking for. The basic setup of my question is this - I have data on all of the students for a school. I then ...
firefly454's user avatar
1 vote
0 answers
41 views

Deciding by RMSE how many simulation results to use for a representative sample

So, I'm doing a brute force Monte Carlo simulation to vary certain parameters and running a model through a thermal computational test bed. At the end I get temperatures for every hour. We have ...
fatalaccidents's user avatar
0 votes
1 answer
600 views

What type of MDS (Multidimensional Scaling) algorithm should I used?

Dataset for User-Page view, which represent in matrix, rows are Users (2000+ or more) and columns ( Pages may be 100+),entries represent frequency(number of time user visit that page), I would like to ...
Ray ben 's user avatar
0 votes
1 answer
211 views

How can I calculate when a text corpus is representative of a language?

I am collecting and analyzing articles and other publications for building a text corpus. I'd like to know how to calculate when my text corpus is representative of a field. That is, how many texts, ...
Jørg Rosmussan's user avatar
0 votes
1 answer
72 views

How to best represent a geographical area as point

I need to check a relationship(?) between land surface temperature (LST) and total population census tract (shapefile) wise where i am trying to relate social factors (e.g. total population, female ...
Learner's user avatar
  • 113
1 vote
1 answer
91 views

Data management of a representative sample

In our original database there are some variables which are quantitative, but actually they are categorical variables. Our question is, should categorization be done in the original database or ...
Happy Cretine's user avatar
1 vote
1 answer
89 views

Sample Representing a Different Population

I have two sets of populations: containing 1.5 million and 5.5 million units. I need to select a sample out of 5.5 million population so that the sample represents the 1.5 million population based on ...
DS_Enthusiast's user avatar
2 votes
1 answer
481 views

Conceptual definition between randomness, representativeness and bias in sampling

I was wondering if you can help me clarifying some concepts (if it is possible providing references to papers or books) that I will write in the form of ideas rather than questions. Consider this ...
Mario GS's user avatar
  • 173
3 votes
1 answer
253 views

Representative resampling

I am working with a population in which each individual has, among others, 6 observed variables that can be 0 or 1: $X_i \sim Bernoulli(p_i),\ i=1,...,6$ . I know the "true" value for the ...
ami232's user avatar
  • 133