Skip to main content

Questions tagged [aggregation]

Refers to "lumping together" potentially inhomogeneous groups of data.

Filter by
Sorted by
Tagged with
0 votes
0 answers
5 views

Pooling Participant Data to Resolve Limited Trials per Condition Issues

Problem: In an experimental task, there are 4 conditions with only 2 trials each, resulting in 8 observations per participant. Typically, we use Signal Detection Theory (SDT) to calculate descriptive ...
StupefiedByYou's user avatar
5 votes
1 answer
281 views

Is it statistically appropriate to aggregate indexes?

I would like to know if aggregating indexes is statistically appropriate. Specifically, I would like to aggregate the CDC’s social vulnerability index (SVI): https://www.atsdr.cdc.gov/placeandhealth/...
KKMK's user avatar
  • 51
1 vote
0 answers
31 views

Combining Data from Multiple Participants for Statistical Analysis of a Facial Expression Memory Task

Context of the Query: I am working on a project involving a memory task for facial expressions, consisting of two phases: Encoding Phase: In this phase, participants are exposed to 8 virtual ...
StupefiedByYou's user avatar
1 vote
0 answers
171 views

Determining an optimal level of aggregation that balances accuracy and granularity

I am looking for ideas for aggregating prediction outcomes in a way that maximizes the number of classes while minimizing classification error. As a motivating example, say I'm working on a prediction ...
mle_in_paris's user avatar
0 votes
0 answers
33 views

How to interpret AggregateExpression() in R?

I am new to scRNA-seq analysis and cell type deconvolution. I am attempting to create a 'pseudobulk' matrix (where rows = genes, columns = cell types, and cell values = TPM) from my scRNA Seurat ...
user avatar
0 votes
0 answers
17 views

Utilizing bipartite network information in standard regression analysis

The gist of my somewhat general question is if there are some useful approaches to utilize information about relationships between individuals embedded in a bipartite network when the goal is a node-...
Denzo's user avatar
  • 572
0 votes
0 answers
32 views

Evaluation of BaggingClassifier using Out-of-bag observations is an indirect evaluation of bagging classifier?

May I know is the following correct? When evaluating a BaggingClassifier using out-of-bag (OOB) samples, the goal is indeed to assess the performance of the ensemble as a whole, rather than focusing ...
jiang xi's user avatar
0 votes
0 answers
46 views

Association between individual treatment & covariates and aggregated survey outcome (per 1 covariate only)

I would like to assess whether employees who perform training (Treatment T) have a better perception of growth opportunities (Outcome Y) in a company given covariates X such as: Gender, Age range Sub ...
Blueheaven's user avatar
3 votes
0 answers
53 views

aggrregated vs. non aggregated data

I am running a TWFE logistic regression to regress a company's exit status, meaning 1 if the invested company had an IPO and 0 if not. I am running the following code specification: ...
lazer's user avatar
  • 31
3 votes
1 answer
65 views

Can I aggregate several continuous variables into percentages and then compare those percentages between groups?

I have a dataset with the concentrations of several lipids. I'm interested in finding lipids that are altered between two conditions, but the lipids are not indepentent from each other and the ...
maglorismyspiritanimal's user avatar
0 votes
1 answer
89 views

Background reason for the terms ‘Isotropic’ and ‘Anisotropic’ in the context of GNN Message Passing

I’m reading a paper on Graph Neural Networks (GNNs) that uses the terms ‘isotropic’ and ‘anisotropic’ in the context of message passing. I understand that these terms originate from physics, chemistry,...
MohammadJavad Vaez's user avatar
3 votes
2 answers
185 views

Item Aggregation Methods in CFA

I've been trying to find any references which have discussed the legitimacy of any item aggregation methods prior to conducting CFA, but I'm coming up short. Here's my context: Large survey with 6 ...
Peter Wesley Odom's user avatar
0 votes
0 answers
22 views

Aggregating daily sampling evidence into a monthly estimate

Suppose there's a business process that's sampled daily for quality review purposes, i.e., a population of items is generated in daily batches, and randomly sampled every day to identify production ...
st1led's user avatar
  • 242
0 votes
0 answers
19 views

Interpolation on bond issuance data

I am currently working on an analysis on bond issuance during the COVID pandemic. I will run a linear regression of spread on multiple bond issuance characteristics but also on multiple firm key-...
Felipe Ramos's user avatar
2 votes
1 answer
87 views

How to aggregate standard errors of multiple test scores?

I have three test scores of a student. The three single scores are generated by an IRT-based test using computer adaptive testing and are reportet with standard error bars. For the report I want to ...
fgrng's user avatar
  • 31
2 votes
1 answer
117 views

Is there a way to estimate or calculate the expected P99 of a sum of distributions?

Suppose I have an event X whose latency I cannot measure directly, but X consists of a bunch of sub-events X_0, X_1, X_2, ..., X_n whose latency I can measure individually only in isolation. ...
merlin2011's user avatar
0 votes
0 answers
21 views

Creating index that considers simultaneous elevation of all variables

I'm creating an index on spatially aggregated (binned) data in R where the final value needs to reflect not only an average of all input variables, but also the "presence" of all variables. ...
mykonos's user avatar
  • 11
2 votes
0 answers
43 views

rank aggregation with partial ranking lists

My question is about rank aggregation, which is in relation with statistics and decision sciences. (if this question is off the topic of this site, plz let me know.) The question is that I have N ...
Maul Seil's user avatar
0 votes
0 answers
12 views

Alternatives to spatial and temporal aggregation of time series to discover more learnable patterns

Given taxi demand time series of towns in a country. I would like to do demand forecasting. I noticed that when the town's time series is zero inflated the prediction is poor. However, when these ...
Jose_Peeterson's user avatar
0 votes
0 answers
31 views

Total generalized variance for Box-Cox transformed components

I have a couple Gaussian mixture models where each component comes from (component-wise) Box-Cox transformed data. These models do not describe the same data: the individual components are selected ...
ladislaw94's user avatar
2 votes
1 answer
333 views

Monthly data with seasonality: is linear regression appropriate?

I have the following situation: there is data for six years, per month. In a year you can see variation per month, since the data is influenced by the seasons. Also, there is an upward trend over the ...
Eva's user avatar
  • 21
0 votes
0 answers
15 views

Aggregating predictions on micro data

I am a machine-learning noob, so please bear with me. I am trying to predict the aggregate number of businesses that will exit (i.e. shut down permanently) in the next quarter (or year). However, my ...
Mishal Ahmed's user avatar
0 votes
0 answers
12 views

Aggregating metrics at parent

I have a model with several independent variables/metrics that each additionally has a corresponding unit, pre-defined upper/lower bounds and a desired value. Now I wish to compute some basic ...
Track9250's user avatar
1 vote
0 answers
31 views

How can aggregation be helpful in mitigating bias?

I am working on the estimation assessing the impact of exposure to infrastructure (mainly schooling) on the number of children. Since I do not have migration data, my colleague recommended that I ...
Yendao Su's user avatar
0 votes
1 answer
26 views

Wondering if averaging datapoints by a set number of observations is a valid way to aggregate data in a scatterplot

So essentially the problem I have is this: I've created an economics simulation which, among other things, tracks the profit rates and capital intensity of all the firms over the course of the ...
Nicosims's user avatar
0 votes
1 answer
76 views

Aggregation of daily correlations to different frequencies

After using the DCC-GARCH model to find the estimated correlations between 2 time series, I would like to perform linear regression with these daily correlations as my dependent variable and test the ...
Jan-Willem van Boven's user avatar
2 votes
0 answers
49 views

Approaches to (non-linear) meta-regression to estimate the conditional population distribution of $y$ based on aggregate data

I want to estimate the distribution of a variable in certain subgroups of the population based on pooling of aggregate data reported in various observational studies. For simplicity, assume there is a ...
user9794's user avatar
  • 216
1 vote
0 answers
56 views

Ordinal logistic regression with aggregated data

I'm wondering if it is feasible to conduct a ordinal logistic regression on the following dataset. I want to investigate if there is a correlation between the alcohol outlet density (as counts) and ...
Gian Gyr's user avatar
1 vote
0 answers
24 views

Best way to analyse two experiments

I'm looking for help/indication on approaching a data integration problem. I have a dose-response curve that is described by a log curve. Because of measurement difficulties, the dose and response can'...
Lu_Ste's user avatar
  • 11
1 vote
0 answers
49 views

Is kruskall wallis appropriate here?

I have collected campaign finance data about donations individuals have made to 3 groups (A, B, C) between 2015 and 2020. Each donor has only donated to one group but some donors have donated ...
user3020416's user avatar
2 votes
1 answer
138 views

Aggregated time series or regression approach?

The setup I describe below is analogous to my actual problem. Problem: I have millions of individuals in my dataset and for each individual, I have certain stats over time. I.e. for one individual Joe,...
Froozle's user avatar
  • 75
0 votes
0 answers
105 views

Loss of variance in aggregated data?

I have a nested dataset where information on individual workplace characteristics is available on the case level, and data on recorded sick leave on the group level. 7k individuals are nested within ...
ym.87's user avatar
  • 1
1 vote
0 answers
159 views

Can I use logistic regression from individual-level survey data to make predictions at an aggregate level?

I have a logistic regression model that predicts the likelihood of an individual getting PTSD after a flood based on their race and gender. The regression is based on a survey of individual flood ...
bashtown's user avatar
0 votes
1 answer
386 views

weighted average in collaborative filtering

I studied on collaborative filtering recently and found that for ratings at last most methods applied were weighted average, no matter what they had proposed, similarity, time, etc. Thus I am ...
Maul Seil's user avatar
0 votes
1 answer
34 views

Calculating average for each individual or not?

I have a question about how I should organize my data before doing some statistical analyses. In my data, I have a sample of rats for which the level of tear stains and body lesions is measured. They ...
balzy's user avatar
  • 139
1 vote
2 answers
1k views

How to solve the problem of having sparse data that would become too small when aggregated?

I have a dataset that provides the count of cyber incidents since 2011 for different countries and different attack types, and I want to use this data in a machine learning model to predict future ...
Traveling Salesman's user avatar
1 vote
1 answer
49 views

Aggregating and averaging time series data to have same nrow per group

I suspect the solution will be pretty straightforward but I'm struggling to figure it out. The problem: I have an experimental design with several video stimuli of different time lengths (between 90s ...
Luminosa's user avatar
  • 111
0 votes
0 answers
17 views

Handling time series data with same start and end datetime but different vector lengths

I am dealing with time series data with 15 different features from a machine. The thing is that the different feature datasets that have been collected have been done at different frequecies. That is ...
Bill Henson's user avatar
1 vote
0 answers
29 views

How does aggregation across time bring about feedback?

On page 11 Pankratz says: "Sometimes there is sound theoretical reasoning in favor of a one-way relationship from the inputs to the output (no feedback). But even then it is important to have a ...
ColorStatistics's user avatar
0 votes
0 answers
167 views

Intuitive explanation of Choquet Integral for data aggregation

I've recently stumbled upon this python package that implements Choquet integral as a way of aggregating data. Does anyone have an intuitive way of explaining how does this integral work in this case?
F.Hand's user avatar
  • 1
0 votes
1 answer
149 views

Q: Aggregating audience and critic movie ratings, and creating a composite rating of the two

I’m building a movie review aggregation site that combines user ratings and critical reviews for a given movie. The objective is to create a list of the “best of the best” movies which were rated ...
GaussianBlur's user avatar
1 vote
0 answers
26 views

Staggered Average and Standard Deviation of incomplete dataset

I have an AxBxC matrix of measurements, from which an arbitrarily-sized-and-distributed number of measurements have been deemed invalid and removed (i.e. that matrix contains a mostly random ...
SysEng91's user avatar
4 votes
1 answer
64 views

What type of statistical inferences are possible on aggregated tables?

I have a table with the following format CountH SubcountH1 SubcountH2 CountK... VarA SubA1 SubA2 SubA3 VarB SubB1 SubB2 . . . The table is filled with ...
William M.'s user avatar
2 votes
0 answers
290 views

How to calculate aggregate standard deviation for composite scores in a meta-analysis

I wonder if someone would be kind and able to provide guidance/suggestions on a stats issue that myself and colleagues are trying to handle while performing a systematic review and meta-analysis. In ...
Antonio Dello Iacono's user avatar
0 votes
0 answers
62 views

Aggregating forecasts and their standard errors over time periods

Good day all, I have an ARIMA model which gives me a weekly forecast and standard error for each period. If I were to aggregate the forecasts into monthly time-windows (for simplicity sake, let's ...
ErrHuman's user avatar
  • 101
1 vote
0 answers
34 views

Combined multiple within-group effect sizes

I'm conducting a meta-analysis on observational studies examined the association of age with different drug groups prescription and in order to combine the effect sizes of all drug groups together, a ...
Fatema 's user avatar
1 vote
1 answer
287 views

Is there a right way to aggregate timeseries data for anomaly detection and forecasting?

Hello Cross Validated Users, I have had a question on my mind for a long time whenever I work with timeseries but I have never quite found the right answer. Here is the thing: when creating an ...
ldoe's user avatar
  • 111
0 votes
1 answer
74 views

How can I verify the correlation between appetizers and main meals

I have a data set of users. that looks something like this. user_id appetizer main_meal 185 30 120 142 8 56 34 0 200 etc. etc. .. there are other columns but I don't believe it's relevant for my ...
Nick's user avatar
  • 123
0 votes
0 answers
55 views

Implications of using the mean of the max as a predictor in regression

What are the implications of using a predictor which has been aggregated twice (the mean of a set of max's) as a variable in a regression analysis? I'm performing a regression on the panel dataset: <...
codemachino's user avatar
0 votes
0 answers
54 views

Obtaining better estimates when you know that a set of input variables are independently and identically distributed

Suppose I have a family of random variables $$X_i \sim SomeDistribution_i, \ \ i = 1,..., n$$ and I know how to sample $SomeDistribution_i$ for any $i$. Suppose I also define a random variable $Y = f(...
user118967's user avatar

1
2 3 4 5 6