All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
2 views

How to compare the difference of two time points of two groups

Let's say I want to compare the height change of female students and male students between two time points. I want to know if there is any difference between males and females in terms of the height ...
user avatar
0 votes
0 answers
5 views

Choose between residual sum of squares (RSS) and comfounded RSS?

In every course I have taken, I was taught to use the residual sum of squares as (part of) the loss function in regressions, either in simple OLS, lasso or other linear regression methods. Recently I ...
user avatar
0 votes
0 answers
6 views

Trying to understand the math behind Avi Wigderson's simple example

In his celebrated talk on randomness and pseudorandomness https://youtu.be/Jz1UoAWD80Q?t=366 legendary mathematician Avi Wigderson makes the powerful statement that sampling is perhaps the most ...
user avatar
  • 101
0 votes
0 answers
5 views

How to find the distribution that minimize the KL distance(divergence) to a known distribution?

Everyone! I'm reading the paper On test marginal versus conditional and I'm a little confused one place in page 9, when the author use "maximum likelihood projection" to get the covariance ...
user avatar
0 votes
0 answers
3 views

Some body help me to understand SVM [duplicate]

I'm beginner of SVM and have difficulty understanding SVM calculating principle. I want calculate SVM formula by hand using simple example. Anybody help me to understand svm showing calcualting ...
user avatar
0 votes
0 answers
4 views

lmer with/without covariates of no interests

I am new to using R and lmer model, so the following question may sound dumb to you, but I do have difficulty with figuring that that :( I have this ...
user avatar
0 votes
0 answers
7 views

Using Inception and FID scores in training?

Is it possible to use the Inception and FID scores in the training of a deep image generation model, i.e. to maximize the scores in a loss function, albeit this is "cheating"? If so, has ...
user avatar
  • 1
2 votes
0 answers
9 views

Confusion on units for the Poisson distribution when it is used to model variables with units

This question stems from the comment section of this question: Bus wait time under Poisson distribution, where it seems that The properties of the Poisson don't make sense for times because the units ...
user avatar
0 votes
0 answers
15 views

Frequency and hypothesis

which does it means? the results were processed using frequency tables of data obtained and expected data with a confidence level of 90% and with 4 degrees of freedom. To test the hypotheses, the chi-...
user avatar
1 vote
0 answers
20 views

Prove $P(X_1+X_2> 2C) \leq P(X_1>C)$ if $X_1,X_2$ are identical, but dependent?

If $X_1,X_2$ are dependent but identically distributed, it seems obvious that $P(X_1+X_2\geq2C) \leq P(X_1\geq C)=P(X_2\geq C)$. At least if we additionally assume that the joint distribution is ...
user avatar
  • 11
0 votes
1 answer
18 views

question of a Poisson random effect model

Assume a Poisson random effect model (with a random intercept) $$\log E(Y_{it}|b_i,x_i)=\beta_0+\beta_1x_i+b_i$$ $$b_i \sim N(0,\tau^2)$$ How to derive the population-averaged effect of one unit ...
user avatar
0 votes
1 answer
12 views

Finding the position of the global optimum with Pytorch

I have a dataset with 22 parameters and I did a PolynomialFeatures = 2 to find the influence of interaction. This was then fitted to an Artificial Neural Network with the lowest loss being around 0.02....
user avatar
  • 23
1 vote
1 answer
17 views

How to check confounding and mediation in large dataset?

Given a large dataset, one cannot possibly check every model. In particular, it does not seem clear to me that one can check confounding or mediation in either cases. How does one check confounding/...
user avatar
  • 839
0 votes
0 answers
7 views

embedding sequences (eg. with doc2vec): do trajectories in the learned (N-dimensional embedding) vector space make any sense?

My data is a collection of temporal sequences of events (each event has a timestamp / or, alternatively, a duration). An example could be sequences of events generated by customers interacting with ...
user avatar
0 votes
0 answers
9 views

How to interpret a Linear Regression in R

I would like to know how to interpret the result from the regression model as the intercept is coming negative.
user avatar
0 votes
0 answers
13 views

"Survival" vs. "Hazard" : When to Use Which?

When dealing with Survival Analysis, we create models that estimate two properties: Survival: Survival Probabilities tend to be more straightforward to understand. Survival Probabilities estimate the ...
user avatar
  • 5,640
1 vote
0 answers
32 views

Publishing paper (research essay) on a 'low hanging fruit' topic

I'm considering spending a few hours publishing a short research paper on a cool statistical concept I stumbled onto. Basically I noticed than an average person's parent has more children than the ...
user avatar
0 votes
1 answer
21 views

Statistical Models for "Prioritization"?

Are there any general classes of statistical models that are able to perform "ranking and prioritization" tasks? For instance, suppose a hospital has: data on patients (e.g. age, height, ...
user avatar
  • 5,640
1 vote
0 answers
15 views

How to test a product of a OLS estimators?

I estimated a vector $\beta $ using OLS $\hat \beta =(\hat e_1 \hat e_2 \hat e_3)$ and I have the covariance matrice $\hat v(\hat \beta )$. How can I test this null hypothesis $H_0 : \hat e_1 \hat ...
user avatar
  • 177
0 votes
0 answers
21 views

Statistical tests have issues for novel data sampling tasks?

Suppose I have a fixed dataset $D:=(x_i)_{i=1}^n$ consisting of $n$ element, sampled in an iid manner, where $n$ is some fixed number. My first question is, for what value of $n$ can we reasonably say ...
user avatar
  • 171
0 votes
0 answers
3 views

Help with generalizing a formula for historical fencing sparing factors

I am writing a small application to aggregate Historical Fencing sparing results. This data is then used to calculate a couple of factors: Effectiveness: simply shows how much of your fights are won (...
user avatar
0 votes
0 answers
3 views

Validate correlations with multiple influence factors

I am having a problem with validating my correlations. To explain the situation: Dataframe 1: the number of observations for each day in 2 years. Dataframe 2: multiple weather and air quality ...
user avatar
  • 101
0 votes
1 answer
25 views

In a time series $x_t, x_{t-1},...,$, why is $E[x_t|x_t, x_{t-1},...]= x_t$?

Sorry if obvious but in a time series $x_t, x_{t-1},...,$, why is $E[x_t|x_t, x_{t-1},...]= x_t$? I don't really get what the random variable $x_t|x_t, x_{t-1},...$ represents? What I find ...
user avatar
2 votes
1 answer
56 views

Testing difference between coefficients of nonlinear regression models

Let us consider following data showing sigmoidal dose-dependence for two distinct compounds (blue and red): I wonder about the best approach of comparing the blue vs red "curves" with ...
user avatar
  • 123
1 vote
0 answers
8 views

Can causal relationships be inferred from a random effects panel model?

Can a causal relationship between two variables be inferred from a random effects panel model? I estimated the following one-way random effects (RE) panel model: $\mathrm{Gini}_{it} = \alpha + \beta \...
user avatar
2 votes
2 answers
35 views

Stratification of the continuous y (target) variable in regression setting

Is it wise to stratify the continuous y (target) variable when you split your training and testing data from the total sample in regression setting? Here is the approach in python to do implement ...
user avatar
0 votes
1 answer
14 views

How to deal with left truncation in cox model in R

I have a longitudinal data with 5 follow-ups. My aim is to see the effect of a disease on ability decline at old age. In my study, I have sibling pairs, one with disease (1) and one without disease (0)...
user avatar
0 votes
0 answers
21 views

Can you help me with distribution/Skewness

Can you tell me if the data normal distributed are? It looks a bit strange. I would say it is skewed 40,80 and so on are sizes of the Apartments in m^2
user avatar
  • 1
0 votes
1 answer
11 views

Is there a statistical software package for the generalized conditional/multinomial logit model?

I have a discrete choice model of moving from one state to the other, so alternatives=states. I have case-specific variables such as income, race, and gender. In addition, I have moving distance ...
user avatar
1 vote
0 answers
16 views

Question about a paper on Calculating All Possible Regressions

I am currently reading the paper "Computational Efficiency in All Possible Regressions" by Liu and it mentions the following. A quick explanation of what I understand: We have a set of $k$ ...
user avatar
  • 11
0 votes
0 answers
8 views

statsmodels.adfuller weird behaviour of usedlag value

I'm learning about time-series analysis and have two series on which I'm performing an Augmented Dickey-Fuller test in order to check for stationarity. I'm trying to understand why I get very ...
user avatar
0 votes
0 answers
5 views

Why include fixed effect in cross sectional ols?

Consider repeated cross-sectional data that contains observations in 10 provinces from 2011 to 2015. Each observation is an individual, but the same person is not observed each year, instead, ...
user avatar
  • 1
2 votes
0 answers
23 views

The probability/cumulative density function for inequality of two random variables

I have two random variables X and Y which came from different inverse gaussian (IG) ...
user avatar
  • 661
0 votes
0 answers
5 views

Getting the arc-lengths of projections along a local principal curve in LPCM [closed]

I have been using the R package LPCM to obtain local principal curves (Einbeck, Tutz, and Evers 2005). I would want to obtain the arc-lengths of the projected points from the beginning of the curve, ...
user avatar
0 votes
0 answers
4 views

How to measure the change in customer flow from brand A to brand B at two points in time (pretest and posttest) after a stimulus?

I am conducting a research in which I have data on the purchase of 4 brands of some consumers in a first period of time (pretest). But I also have the data for the purchase of those 4 brands and the ...
user avatar
  • 1
0 votes
0 answers
14 views

Fisher's exact test when resampling from the population

I am using different ML classifiers for making predictions related to a binary classification. I would like to compare two groups. Let's call them A and B. The already trained and tested classifier ...
user avatar
0 votes
0 answers
3 views

Why is the value of SE for the transformed regression model higher than the initial model with autocorrelation?

Is it right that with positive autocorrelation, the model underestimates the SE. Hence, using generalized differencing, the transformed model has a higher value of SE? And if so, what happens to a ...
user avatar
0 votes
0 answers
6 views

Getting distances from points to their principal curve projections in R princurve? [closed]

I have been using the R package, princurve, to calculate principal curves. Now I want to obtain the squared distances from the points I used to fit the principal curve to their projections in the ...
user avatar
0 votes
0 answers
9 views

How can I estimate the variance of the error terms in a conditional/multinomial logit model?

Conditional/multinomial logit models(CML) can be esimated by the Maximum Likelihood Estimation(MLE). The likelihood would consists of choice probabilities: \begin{equation} P_{ij}=\frac{e^{V_{ij}}}...
user avatar
0 votes
0 answers
8 views

Shrinkage / L1 regularization as a loss term versus a constraint (post-process step) with momentum optimizers

I have a complex model with very non-linear operations (divisions, exponentials, matrix inversions, square roots, Cholesky decompositions, etc...) for which I want to optimize the parameters. However, ...
user avatar
0 votes
1 answer
21 views

Problem formulating a hypothesis test for the mean

Suppose that I would like to support the following hypothesis: h = The average weight of people in New York is 70kg. If I take h to be the null hypothesis then I can only reject it (I assume that ...
user avatar
  • 881
0 votes
0 answers
14 views

Why is my kNN performance bad?

I am using the Wisconsin Breast Cancer Data Set from sklearn, and wanted to apply simple classifiers on it. The data labels are binary, has around 31 numerical features and in total 569 instances. So, ...
user avatar
  • 1
2 votes
1 answer
26 views

Should I join train and validation sets for final NN model training? If yes, when to stop training the final model?

Normally we divide our dataset into 3 sets: train set, validation set, test set. We use train set to find optimal parameters (weights and biases of NN) and validation set to find optimal NN ...
user avatar
0 votes
0 answers
11 views

How to run a multilevel regression model with crossed random effects: items and participants?

I am trying to run a multilevel regression for my study: I have two random effects; participants (97) and items (which are the 20 words used in the study) Each participant had to spell the same words. ...
user avatar
1 vote
0 answers
9 views

is nrmse scale-dependent?

Im trying to evaluate my regression models using a normalised version of the RMSE, nrmse = rmse(y, y_pred)/rmse(y, y_mean) where y_mean is the array of the same len as y filled with the mean value of ...
user avatar
  • 11
0 votes
0 answers
11 views

How do you get this bifurcation diagram of this 2D discrete time model?

I want to replicate the results of "Chaos in Duopoly Pricing" by T. Puu, which can be found here: https://www.sciencedirect.com/science/article/pii/096007799190045B#section-cited-by. The ...
user avatar
1 vote
0 answers
22 views

Mean-level forecast from rugarch does not match manual calculation

I am looking into the rugarch package and am trying to understand how the one-step-ahead forecast is calculated. Specifically, I am fitting an AR(2)-GARCH(1,1) ...
user avatar
  • 11
0 votes
0 answers
26 views

Estimating Top n Prices points on a given day for a particular product which would maximize revenue

Problem Statement :- On any given date of the year, get top n prices which would maximize the revenue for that day for a particular platform. Dataset :- Date Price ($p_{i}$) Platform $X_{1,i}$, $X_{...
user avatar
  • 133
1 vote
1 answer
21 views

LinearRegression in Pytorch and sklearn, what is the differnece?

I am currently implementing Linear Regression in Pytorch and sklearn and I get two different Mean squared error (MSE) values for both. MSE is lower for Pytorch Linear Regression. Wanted to ask what ...
user avatar
  • 23
0 votes
0 answers
13 views

Interpret output for the standardised difference in stata [closed]

I have an output for the standardised difference using the stddiff command in Stata. How do I interpret it?
user avatar
  • 1

15 30 50 per page
1
2 3 4 5
3877