The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
1answer
11 views

Methodology: breaking multi-regression apart

I have to perform a multiple regression where my independent variable is store visits, while the dependents include hour of day, day of week, and others. I need to do this in Excel. Excel limits ...
2
votes
0answers
28 views

Rigorous theory behind overfitting

I am taking an intro to ML class, and in my limited experience, training ML algorithms (validation, overfitting etc.) feels a bit like black magic. For instance, you aren't supposed to touch the test ...
0
votes
0answers
11 views

How to test statistical significance to prove that a particular technique estimates a variable better than another technique?

Suppose the following is the scenario: I am estimating the measure of a construct. I have Subject Matter Experts (SME) who have manually (through observation) estimated the measures. Suppose I have ...
2
votes
0answers
24 views

Can I replace traditional DSP with statistical methods

I work a lot with noisy time traces with usually 2.5e6 data points and sampling frequency ~ MHz. I usually apply some "traditional" digital signal processing utilities like low/high-pass filters to ...
2
votes
1answer
26 views

What tradeoffs are there between internal and external validity?

I was reading through an article about research design. The authors gave an example on the relation between internal and external validity which I thought might be an important area of consideration ...
1
vote
0answers
57 views

non-linear regression predictions goodness of fit

I have a non-linear model that, given some parameters and the initial state of the system can predict the outcome of this system after t times. I had train my model using some data and I'm now trying ...
1
vote
0answers
22 views

Statistical methods for adjusting heaping in birth weight data

I have a birth weight data of children under aged 5 years (sample size, n=2000). Data comes from two sources : 1. Mothers recall (n=1500) and Health card (n=500). Naturally, mothers' recall data ...
0
votes
0answers
16 views

propensity match advice

I need some advice on how to tackle this problem. I have two groups (treatment n=30 and no-treatment 400). I want to match the treatment group patients to the other group based on comorbidities and ...
0
votes
1answer
25 views

Appropriate analysing methods for theoretical questions

I am currently trying to analyse a set of data from a survey conducted that has a lot of YES/NO questions. For instance, one question asks if the respondent currently has a data plan with their ...
1
vote
1answer
35 views

Is it methodologically valid to try multiple feature selection methods and report the best?

I am working on a classification problem. I have used multiple feature selection methods, and a model is selected (i.e. hyperparameter optimization) and trained for each of the selected features. I ...
1
vote
0answers
24 views

Accounting for variation between populations when comparing failure rates

Here's my situation. The big picture is that I need to figure out how to compare the failure rates of two groups of widgets, Group A (defect) and Group B (control), in such a way that answers the ...
0
votes
0answers
36 views

Proportion dependent variable (0-1 range) in an unbalanced, non-dynamic panel

I am a PhD student currently performing data analysis for my publication and have the following problem: Dataset: unbalanced data of around 80 firms over 20 year period (due to firms entering and ...
0
votes
3answers
388 views

Distance measure methods of R function dist() evaluation

I want to compute the distance matrix for the columns on a 1000 x 230 matrix using the dist() function in R. Though, I am uncertain about which method to use. I ...
0
votes
1answer
17 views

Can age,education level and socioeconomic status be controlled but not as covariates to strengthen an experimental study?

Most ppl include age, education level and socioeconomic status in their demographics just to show their sample of study. But in my case all those 3 factors are predictors of my DV which is prosocial ...
0
votes
0answers
18 views

Is it possible to decompose 3-factor change in growth rate terms?

Let's say, we investigate what caused the growth in working-age population (W). There are basically three factors causing the change in W. First, mortality at working ages (MT). Second, migration ...
0
votes
0answers
36 views

Is Multiple Regression the right choice for my statistical design?

I am studying the relationship between mental health offices and judgments of perceived care expected within those environments. Participants will rate different photographs of mental health offices ...
0
votes
0answers
76 views

Running Multiple Linear Regression in R with 3 Factors and 1 Continuous Variable

I am running a Multiple Linear Regression model using R. I am looking at travel behavior and most of the variables are factors with YES or NO as responses. However, I am concerned about using 3 ...
1
vote
0answers
28 views

Is there a resampling method that blends subsampling with the bootstrap?

I apologize if this is an inappropriate question. I thought of it in class the other day, and I couldn't find a specific answer in my textbooks. I am familiar with the two basic techniques for ...
10
votes
1answer
1k views

When to use Poisson v. Geometric v. Negative Binomial; GLM, the Three Count Variable Distributions

I'm trying to layout for myself when it's appropriate to use which regression type (geometric, poisson, negative binomial) with count data, within the GLM (only 3 of the 8 GLM distributions are used ...
0
votes
0answers
241 views

What model to use? Heckman-Two-Stage? Tobit? OLS?

I am currently researching innovation with firm level data. I have a nice dataset, which allows to analyze the variable inno which is ...
0
votes
0answers
14 views

Disadvantages of cluster randomised controlled trials

Can anyone explain some of the disadvantages of a cluster randomized controlled trial? I read something about data being more correlation between partiticipnts in each condition/group but I don't ...
0
votes
0answers
13 views

Variable selection algorithm based on meta study

Suppose I would like to conduct a survey and want to know which variables to include. Literature review and theoretical guidance both help. What I would like to know is whether there is a way to do a ...
0
votes
1answer
75 views

Methodological question: adjusting for confounders in logistic regression

I have three attributes in a dataset (D0), representing the binary response of success or failure (R), some form of treatment or treatment group (T), and a potential confounder (C) respectively. ...
1
vote
1answer
43 views

Split-half when intermediate values are equal

I am trying to perform a split-half for strategy use, however, as you can see the middle most users have the same score. What is the best approach to perform a split-half in this situation? Do you ...
0
votes
0answers
18 views

Best Methodology

I am currently designing a research project on mental health attitudes. I want to test a model that should explain the data. I have 5 variables that should lead in an almost linear causal pattern of ...
0
votes
1answer
58 views

Find determining variables between two groups

I have a large dataset with many variables (for example: height, weight, color, category, revenue...) I am trying to compare two groups and find which variables determine the groups. My goal would be ...
0
votes
1answer
48 views

Different groups, same intervention. What design is this?

I'm trying to figure out the best way to analyse the following clinical trial: Group1: Healthy individuals Group2: Diseased individuals Both groups follow the same intervention and are tested pre- ...
3
votes
1answer
333 views

Calculating Diversity using normalized species counts

I am trying to calculate the change in diversity of species encountered throughout time. My dataset is comprised to detections of tagged fish for 48 consecutive weeks. My thought was to bin the ...
0
votes
0answers
34 views

Okay method to aggregate moving averages?

I want to make a map of investments in foreign countries made by country x. I have collected data for a ten-year period. Since investments change from year to year and there's lack of data for some ...
0
votes
0answers
135 views

using loess to smooth data improves correlation. What I'm seeing here?

I'm reviewing a work of some collegues which correlates the daily number of tweets on certain topic with some other indicators. They used of loess smoothing regression to diminish the noise of the ...
1
vote
2answers
52 views

Methods for compiler benchmarking?

In computer science, statistical knowledge is quite low in general. You rarely see standard deviation in papers. Now I am trying to improve at least my skills, but I find myself utterly confused about ...
0
votes
0answers
65 views

What wrong with this experiment methodology?

The following experiment was devised: a group (random) was divided randomly into 2 : Half were give coffee A the others coffee B, all rated it on a 1-5 Likert scale. Results where analyzed using ...
0
votes
0answers
121 views

How to determine an appropriate sample size for a normal distributed population?

I am trying to extract a sample from a given population. Assuming the population distribution is normal (I still have to test it, but I am confident it is), since the number of observations in the ...
6
votes
1answer
186 views

Statistics for model selection and model evaluation

In his Dynamic Econometrics, David F. Hendry issues the following advice: When a 'test' statistic is cited, you must ask 'Was that a selection criterion statistic or a genuine test statistic?' ...
5
votes
2answers
39 views

Validity of combining surveys and sociodemographics to estimate miles walked in census tracts

I ran across this paper that describes an interesting approach to combining survey and sociodemographic data: Salon. Estimating Total Miles Walked and Biked by Census Tract in California. State of ...
8
votes
3answers
673 views

What are criteria and decision making for non-linearity in statistical models?

I hope that the following general question makes sense. Please keep in mind that for the purposes of this particular question I'm not interested in theoretical (subject domain) reasons for introducing ...
4
votes
1answer
256 views

Review of Box-Jenkins methodology

i just finished developing an ARMAX model with python (mostly statsmodels) in order to forecast some data. My next step is to test the data (24 time series) with the given ARMAX model. As i need to ...
0
votes
0answers
26 views

Methane Flux Undergraduate dissertation [closed]

I'm trying to do a research project into how methane (units mg CH$_4$ m$^{-2}$ d$^{-1}$) and CO$_2$ flux (units mg CO$_2$ m$^{-2}$ d$^{-1}$) in a Canadian peatland is influenced by temperature, soil ...
4
votes
2answers
88 views

Research methodology, statistical literacy and communication

When talking to clients or offering advice, I often find myself having to question the choice of plotting variables over time. For example, if a client is interested in understanding the relationship ...
1
vote
0answers
22 views

Multiple groups - how to regularise estimate of level 1 parameters based on level 2

I am fitting some relatively complex structural equation models, but the specific model is not so important. I am estimating multigroup models, such that one parameter is completely free across ...
2
votes
0answers
36 views

Violating Independence - Methodological Question

I am looking again at a popular statistical testing method used in finance, suspect it's a bit naughty, but would like to have a more experienced eye take a look also. The method is the following, ...
1
vote
4answers
440 views

A summary of econometric methods

Scikit Learn has a guide for machine learning techniques. Matthias Vallentin did a remarkable cheat sheet/cookbook for probability and statistics. Many heavy summaries of econometric methods are ...
1
vote
0answers
27 views

post-stratification of ACS survey

I have a survey methodology question. I am preparing a report that contains some demographic information. My supervisor instructed that I use the NCHS bridged-race population estimates when reporting ...
0
votes
2answers
47 views

Is there any good reference which statistical test should be used given study design?

I am looking for a source (infographics, picture, graph, list, book, algorithm or whatever) that clarifies which statistical test should be used when. I mean what do I use when I have two unpaired ...
0
votes
0answers
52 views

Analysis to use with categorical predictors and continuous response variables

I am trying to figure out what the right statistical test to use is for data where the DV is continuous, and the IV's are categorical. There are a lot of different DV's that I want to run through a ...
2
votes
1answer
56 views

Is this method of finding the confidence interval correct?

Suppose that we have 2 sets of data $X = x_1, \dots, x_n$ and $Y = y_1, \dots, y_m$ and a test $T$ that tests the null hypothesis that these data come from a distribution with the same median. $T$ can ...
5
votes
2answers
200 views

Unwritten laws and dirty tricks to influence the outcome of a regression analysis

Background: Some years ago, I was working for a professor specialized in macroeconometrics. As a student research assistant, it was my task to replicate other papers and "play around" with the data. I ...
2
votes
0answers
44 views

Help finding method of estimating regression parameters for a given performance

Pardon my ignorance, for I have very basic training in statistics, but have never taken a regression course. I ran an experiment where participants are in one of two conditions (between subjects). ...
0
votes
0answers
30 views

How did Gallup form this index?

I am reading this Gallup poll, and in it there is a "Positive Experience Index" that is used without really explaining how it was created, and therefore what, precisely, it means. From reading the ...
1
vote
2answers
72 views

What is the correct term for testing a classification method on different subsets of the same data

I am searching for the correct definition of a methodology I am using to test the robustness of different classification methods. I am creating different subsets of the full dataset by cutting away ...