Questions tagged [mathematical-statistics]
Mathematical theory of statistics, concerned with formal definitions and general results.
7,135
questions
0
votes
0
answers
23
views
How to choose between one-way, two-anova and multliple regression?
I am working on the data set that consists of Patients' id (after stroke), Time (they can walk after going through the program), the Program they follow and the Visit number when the Time was measured....
- 45
0
votes
0
answers
14
views
Expectation values [closed]
What is the expectation value of the expectation value. How to calculate:
<∆j> where, ∆j=spread of data= j-<j.> ;for any variable j
- 1
2
votes
1
answer
17
views
What is the impact of duplicate data on the variance of regression coefficient? [duplicate]
What is the impact of duplicate data on the variance of the regression coefficient?.
Does increasing the size of data always certainly decrease the variance of the model coefficients?
Suppose I have ...
- 21
0
votes
0
answers
9
views
Sufficient Statistic and UMVUE [closed]
I have this example and I'm struggling to solve it
Say that I have this Independent and identically distributed sample with density
$ f(x,\theta)= \frac{3x^2}{\theta^3} , 0 \le x \le \theta,$ $\...
3
votes
1
answer
42
views
What is meaning of such notations in general?
I read a notation on a paper about statistics and machine learning ("High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models" by
Tengyuan Liang,
Subhabrata Sen, and Pragya ...
- 262
0
votes
0
answers
24
views
Find asymptotic variance of the moment estimator
I have that
$$f(x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}x^2}$$
I have the conditional distribution:
$$f_{\beta}(y|x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}(y-\beta_0-\beta_1x-\beta_2x^2)^2}$$
and we ...
- 253
0
votes
0
answers
18
views
Uniform distribution of skewed dice and the central limit theorem
I am reading MacKay's Information Theory, Inference, and Learning Algorithms. I am not a student.
On pg. 36, ex 2.16, c and d:
C. How can two cubical dice be labelled using the numbers
{0,1,2,3,4,5,6}...
- 371
0
votes
0
answers
20
views
Derivation of F distribution from quotient distribution
I'm looking for the derivation of the F distribution. There is a fairly understandable (for me) derivation presented on this site: http://www.milefoot.com/math/stat/pdfc-fdist.htm.
On this site, the ...
- 1
3
votes
1
answer
82
views
In elastic net regularisation, will dividing the OLS term the number of observations cause misleading results when cross-validating?
Two formulations of the elastic net regression function
Consider sklearn's implementation of elastic net regularisation (Wikipedia link). From the docs, it works by ...
- 31
1
vote
0
answers
34
views
Issue with bounded in probability
I have tried to prove the following problem that I read in the lecture and it seems not transparent to me.
Suppose that $Y_{i}$ be independent random variables (with $i=1,2,3, \dotsc$). Each has the ...
- 23
0
votes
0
answers
25
views
Can a Box-Muller transformation work on a different uniform interval? [closed]
It's known that the Box-Muller transformation generates random numbers from a uniform distribution on the interval from $[0,1]$. Can we do this on a different interval, so for any finite number $n>...
- 113
0
votes
0
answers
3
views
How to determine how much variation was due to the differences between a group?
I am working on the data set that consists of Patients (after stroke), Time (then can walk after a going through the program), and Program they follow.
...
Marta
0
votes
0
answers
11
views
Find fisher information matrix for optimization estimator
I have that
$$f(x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}x^2}$$
I have the conditional distribution:
$f_{\beta}(y|x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}(y-\beta_0-\beta_1x-\beta_2x^2)^2}$
and we have ...
- 253
0
votes
0
answers
11
views
How to have a constant error[b-a] for a range of values [1d array] in decending order that are not linear but are semi-linear?
I am trying to generate n numbers in decending order (for the purpose of decreasing order of weights) such that their sum should be 100 and more importantly the difference between anytwo numbers ...
- 1
0
votes
1
answer
14
views
Error Terms in the ANOVA Summary Table
my lecturers require us to write the error term for the effect/source in the ANOVA summary table. Such as below:
I don't understand how to find which S(error) term goes to which source. And I do know ...
- 1
0
votes
0
answers
24
views
Can somebody help me understand the sentences in more readable expresions?
I was reading a paper about "bayesSimIG" and I have problem in understand the following paragraph.I have read it many times and did a lot of research for it and have understood what each ...
- 2,585
0
votes
0
answers
32
views
Normalize a Dataset with Min/Max formula [closed]
I have 7 groups of data (let's say g0 all the way to g6)
I want to normalize g0, and I apply the following function only to the elements of g0:
...
1
vote
2
answers
35
views
Proof of statistical assumptions behind the methods or tests
When reading statistics literature, they provide the assumptions of when specific tests/methodologies can be used. Take factor analysis as an example; you may find this inside a paper: "Generally ...
- 135
0
votes
0
answers
16
views
Is there a boundary between statistical and machine learning methods?
I want to better understand what exactly is considered "machine learning" or not. I realize there might not be a categorical answer for this, but that's what I want to understand.
...
- 1,082
0
votes
1
answer
48
views
football probability
I have the following problem:
Suppose that the probability of a football team (T) to win the match
with 2-1 is p1 and, given that T scores a goal, the probability that
the best player of the team ...
0
votes
0
answers
17
views
Detailed comparison of two methods for obtaining the ridge regression solution
I have come across two different ways of obtaining the ridge regression solution, which are as follows:
Method1:-(obtained from here)
$RSS(\beta) = (Y-X\beta)^T\cdot(Y-X\beta)+\lambda\beta^T\Omega\...
- 187
2
votes
1
answer
57
views
+50
Bounds on the conditional variance of a truncated binomial
I have a binomial variable $R$ drawn from $binom(N, p)$, and I'm interested in the variance of $R$, given $R \ge Q$. The pmf of this variable $R^*$ is
$$
\phi_{R^*}(l) = \frac{\phi(l, N, p)}{P}
$$
...
- 235
-1
votes
1
answer
25
views
How can I calculate Posterior Distribution, analytically with given information?
The image below shows that the posterior distribution is as follows with given information:
I wonder how the posterior has been calculated, analytically.
- 2,585
1
vote
2
answers
43
views
Conditioning of join gaussian over a line
I need to compute the conditional probability of bivariate normal distribution over a line.
Let's suppose that X and Y both are normal distributions and that they are independent.
Let's suppose that ...
- 117
3
votes
0
answers
35
views
Gauss-Markov with $p>n$
Let $p$ be the number of parameters in a linear regression model, let $n$ be the number of observations, and let $p>n$.
$$\mathbb E[Y\vert X] = \beta_0 +\beta_1X_1 +...+\beta_pX_p$$
Does the Gauss-...
- 31.1k
1
vote
0
answers
15
views
Derivation of residual bivariate expression to find the value for a multiple linear regression coefficient
Could someone help me with this derivation? How do I get to this expression of $k$?
$y_i=\beta_0+kT_i+\beta_1X_{1i}+...+\beta_kX_{ki}+u_i$
$k = \frac{Cov(Y_i, \tilde{T_i})}{Var(\tilde{T_i})}$
where $\...
- 113
0
votes
2
answers
32
views
Mathematic modelling vs. machine learning
As a biologist with some background in mathematics I am really interested in mathematical modelling of biological processes, like tumor development or therapy responses. However, looking at recent ...
-1
votes
0
answers
38
views
Most marketing channel have negative coefficient in econometrics model for sales?
This is the first time I am working on an econometrics model (Market Mix Modelling) for sales. I have weekly sales data and the number of impressions from various marketing channels like FB, Twitter, ...
0
votes
0
answers
24
views
Determining Percentile Ranking of Test Score Given Individual Score, Population Mean, and Standard Deviation
I have recently received an exam grade of 160/200. In addition to this, I have been given the information that the mean score amongst all students was 114.25 and the standard deviation was 45.62. ...
- 1
3
votes
1
answer
32
views
Why do discrete choice models (such as MNL) not require test set?
The central challenge of Machine learning models is perform well on unseen data. The data is randomly split into train and test set. The test set acts as surrogate for unseen data and is used to ...
- 141
1
vote
1
answer
16
views
sufficient, minimal, complete
Are all complete statistics functions of each other?
For example if I have T and S complete statistics
Can you always write T in terms of S and S in terms of T?
4
votes
1
answer
170
views
variance of the difference of two independent variables is the sum of variances
It is said that variance of the difference of two independent variables is the sum of variances (topic - Confidence intervals. Two means. Independent samples)
I tried to experiment with small dataset ...
- 41
3
votes
0
answers
46
views
Does the likelihood ratio test violate the likelihood principle?
I've been going over Berger's famous example of negative binomial vs binomial sampling leading to two different p-values conditional on the same observed data. To summarize, suppose we observe 9 tails ...
- 51
1
vote
0
answers
35
views
Is it possible to prove that this function of the truncated binomial is decreasing?
Suppose a random variable is binomially distributed with $G$ trials and success probability $p$.
Consider the expected proportion of successes, given that the proportion of successes is at least $k$:
$...
- 235
0
votes
1
answer
31
views
Are there possibilities to determine 95% confidence interval for right skewed data?
The dataset that I'm using for my thesis is right skewed. It is about lead times (days) I tried log10 transforming it in SPSS but it still does not meet the requirement p>0,05 (Shapiro-wilk). So ...
- 1
0
votes
0
answers
52
views
What is the conditional expectation of two random Poisson variables?
Say I have two random variables $Z^{p}_{i} \mid Y^{p}_{i} \sim \text{Poisson} \left(t^{p}_{i}Y^{p}_{i}\right)$ and $Z^{q}_{i} \mid Y^{q}_{i} \sim \text{Poisson} \left(t^{q}_{i}Y^{q}_{i}\right)$ for ...
0
votes
0
answers
28
views
Comparing current and new version of Autoencoder
I am building an LSTM Autoencoder (unsupervised model) to detect anomalies in a time series dataset. The input is telemetry data from routers and I want to detect anomalies in the throughout of ...
3
votes
1
answer
34
views
two sample t-test for non-normal population
I assume this question has been beaten to death and thus I am just looking for a reference which goes through the details.
Assuming all populations we deal with have finite means and variances (even ...
- 133
0
votes
0
answers
29
views
What is my best option to evaluate a predictive (or proxy) variable?
I have a list of thunder flashes, and I'm trying to find if a meteorological variable (CAPE) is a good predictable variable (or proxy) for theses flashes. In my thoughts, I want to evaluate this proxy ...
- 1
0
votes
0
answers
7
views
How to generate a general trend from hundreds of time-series data
I have hundreds of time-series data from individual experiments[2] with a similar trend that reading rises as time goes by (evaluated by my naked eyes). So what statistical tools should I use to ...
- 217
1
vote
0
answers
17
views
Visualization of $L(X)$
Let $L^2_+$ the set of all $2$-dimensional nonnegative random vectors $X = (X_1, X_2)^⊤$ with finite and positive marginal expectations, and let $Ψ^{(2)}$ the class of all measurable functions from $\...
- 111
0
votes
0
answers
20
views
How to find expected value from cumulative distribution function?
Hello everyone, I'm currently doing research based on the model in Competitive fit-revelation sampling and mixed pricing strategy (Wu &Deng, 2021). And I don't understand how they can conclude the ...
- 1
0
votes
0
answers
19
views
Identification of a pattern based on given features in time-series data
I am working with electricity time-series data collected at 15 minutes intervals. I am looking for a procedure/theory to find the pattern/sequence in the time-series data based on given features.
As I ...
- 23
0
votes
1
answer
66
views
Suppose $X$ and $Y$ have joint pdf $f(x,y) = 0.5,$ for $0 \le x \le 1;$ $0\le y\le2.$ Evaluate $P (Y >X).$
Kind of lost where to start with this. Could be easy but I don't know where to start simply by knowing $f(x, y) = 0.5.$
How can I find the probability $P(Y > X).$
- 13
0
votes
0
answers
14
views
What is the best statistical test for correlation between 2 ordinal variables? [duplicate]
"1st variable is ranking
2nd is Likert scale
I am to correlate the motivation scale (Likert) to job preference (ranking)"
- 1
0
votes
0
answers
39
views
sufficient statistics for bernoulli distribution
Let Y1, . . . , Yn be a random sample of size n where each Yi ~ Bernoulli(p), and
let Y = $\sum$ Yi for i = 1, . . . , n.
The estimator is W= (Y+1)/(n+2)
Is the estimator a sufficient statistics for ...
2
votes
1
answer
52
views
Model performance when ground truth is not available
I am building an LSTM Autoencoder (unsupervised model) to detect anomalies in a time series dataset. The input is telemetry data from routers and I want to detect anomalies in the throughout of router....
2
votes
1
answer
51
views
Proof that a necessary condition for characteristic roots to lie inside unit circle is $\sum\limits_{i=1}^{n} a_{1} < 1$
I have been trying to show that given $$P_{n}(\alpha) = \alpha^{n} - a_{1}\alpha_{n-1} - a_{2}\alpha^{n-2}... - a_{n} = 0,$$ the $\alpha$'s that solve this equation (real-valued or complex) lie in the ...
- 133
1
vote
1
answer
19
views
How to test for an "interaction" between two interactions
I plan to apply a LMM with the following structure: Y ~ A1 + A2 + A3 + A1:A2 + A1:A3 + (1|subject). I expect the two interactions to display opposing patterns (...
- 11
0
votes
0
answers
8
views
Sufficient conditions for equivalence between regression on individual or group average data
I have often hear that running a regression on individual or (properly weighted) aggregated data should give the equivalent results, for example in this question or in Mostly Harmless Econometrics, ...
- 253