Questions tagged [mathematical-statistics]

Mathematical theory of statistics, concerned with formal definitions and general results.

Filter by
Sorted by
Tagged with
0 votes
0 answers
23 views

How to choose between one-way, two-anova and multliple regression?

I am working on the data set that consists of Patients' id (after stroke), Time (they can walk after going through the program), the Program they follow and the Visit number when the Time was measured....
user avatar
0 votes
0 answers
14 views

Expectation values [closed]

What is the expectation value of the expectation value. How to calculate: <∆j> where, ∆j=spread of data= j-<j.> ;for any variable j
user avatar
  • 1
2 votes
1 answer
17 views

What is the impact of duplicate data on the variance of regression coefficient? [duplicate]

What is the impact of duplicate data on the variance of the regression coefficient?. Does increasing the size of data always certainly decrease the variance of the model coefficients? Suppose I have ...
user avatar
0 votes
0 answers
9 views

Sufficient Statistic and UMVUE [closed]

I have this example and I'm struggling to solve it Say that I have this Independent and identically distributed sample with density $ f(x,\theta)= \frac{3x^2}{\theta^3} , 0 \le x \le \theta,$ $\...
user avatar
3 votes
1 answer
42 views

What is meaning of such notations in general?

I read a notation on a paper about statistics and machine learning ("High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models" by Tengyuan Liang, Subhabrata Sen, and Pragya ...
user avatar
  • 262
0 votes
0 answers
24 views

Find asymptotic variance of the moment estimator

I have that $$f(x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}x^2}$$ I have the conditional distribution: $$f_{\beta}(y|x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}(y-\beta_0-\beta_1x-\beta_2x^2)^2}$$ and we ...
user avatar
  • 253
0 votes
0 answers
18 views

Uniform distribution of skewed dice and the central limit theorem

I am reading MacKay's Information Theory, Inference, and Learning Algorithms. I am not a student. On pg. 36, ex 2.16, c and d: C. How can two cubical dice be labelled using the numbers {0,1,2,3,4,5,6}...
user avatar
  • 371
0 votes
0 answers
20 views

Derivation of F distribution from quotient distribution

I'm looking for the derivation of the F distribution. There is a fairly understandable (for me) derivation presented on this site: http://www.milefoot.com/math/stat/pdfc-fdist.htm. On this site, the ...
user avatar
3 votes
1 answer
82 views

In elastic net regularisation, will dividing the OLS term the number of observations cause misleading results when cross-validating?

Two formulations of the elastic net regression function Consider sklearn's implementation of elastic net regularisation (Wikipedia link). From the docs, it works by ...
user avatar
  • 31
1 vote
0 answers
34 views

Issue with bounded in probability

I have tried to prove the following problem that I read in the lecture and it seems not transparent to me. Suppose that $Y_{i}$ be independent random variables (with $i=1,2,3, \dotsc$). Each has the ...
user avatar
0 votes
0 answers
25 views

Can a Box-Muller transformation work on a different uniform interval? [closed]

It's known that the Box-Muller transformation generates random numbers from a uniform distribution on the interval from $[0,1]$. Can we do this on a different interval, so for any finite number $n>...
user avatar
  • 113
0 votes
0 answers
3 views

How to determine how much variation was due to the differences between a group?

I am working on the data set that consists of Patients (after stroke), Time (then can walk after a going through the program), and Program they follow. ...
user avatar
0 votes
0 answers
11 views

Find fisher information matrix for optimization estimator

I have that $$f(x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}x^2}$$ I have the conditional distribution: $f_{\beta}(y|x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}(y-\beta_0-\beta_1x-\beta_2x^2)^2}$ and we have ...
user avatar
  • 253
0 votes
0 answers
11 views

How to have a constant error[b-a] for a range of values [1d array] in decending order that are not linear but are semi-linear?

I am trying to generate n numbers in decending order (for the purpose of decreasing order of weights) such that their sum should be 100 and more importantly the difference between anytwo numbers ...
user avatar
  • 1
0 votes
1 answer
14 views

Error Terms in the ANOVA Summary Table

my lecturers require us to write the error term for the effect/source in the ANOVA summary table. Such as below: I don't understand how to find which S(error) term goes to which source. And I do know ...
user avatar
  • 1
0 votes
0 answers
24 views

Can somebody help me understand the sentences in more readable expresions?

I was reading a paper about "bayesSimIG" and I have problem in understand the following paragraph.I have read it many times and did a lot of research for it and have understood what each ...
user avatar
  • 2,585
0 votes
0 answers
32 views

Normalize a Dataset with Min/Max formula [closed]

I have 7 groups of data (let's say g0 all the way to g6) I want to normalize g0, and I apply the following function only to the elements of g0: ...
user avatar
1 vote
2 answers
35 views

Proof of statistical assumptions behind the methods or tests

When reading statistics literature, they provide the assumptions of when specific tests/methodologies can be used. Take factor analysis as an example; you may find this inside a paper: "Generally ...
user avatar
  • 135
0 votes
0 answers
16 views

Is there a boundary between statistical and machine learning methods?

I want to better understand what exactly is considered "machine learning" or not. I realize there might not be a categorical answer for this, but that's what I want to understand. ...
user avatar
0 votes
1 answer
48 views

football probability

I have the following problem: Suppose that the probability of a football team (T) to win the match with 2-1 is p1 and, given that T scores a goal, the probability that the best player of the team ...
user avatar
0 votes
0 answers
17 views

Detailed comparison of two methods for obtaining the ridge regression solution

I have come across two different ways of obtaining the ridge regression solution, which are as follows: Method1:-(obtained from here) $RSS(\beta) = (Y-X\beta)^T\cdot(Y-X\beta)+\lambda\beta^T\Omega\...
user avatar
  • 187
2 votes
1 answer
57 views
+50

Bounds on the conditional variance of a truncated binomial

I have a binomial variable $R$ drawn from $binom(N, p)$, and I'm interested in the variance of $R$, given $R \ge Q$. The pmf of this variable $R^*$ is $$ \phi_{R^*}(l) = \frac{\phi(l, N, p)}{P} $$ ...
user avatar
  • 235
-1 votes
1 answer
25 views

How can I calculate Posterior Distribution, analytically with given information?

The image below shows that the posterior distribution is as follows with given information: I wonder how the posterior has been calculated, analytically.
user avatar
  • 2,585
1 vote
2 answers
43 views

Conditioning of join gaussian over a line

I need to compute the conditional probability of bivariate normal distribution over a line. Let's suppose that X and Y both are normal distributions and that they are independent. Let's suppose that ...
user avatar
  • 117
3 votes
0 answers
35 views

Gauss-Markov with $p>n$

Let $p$ be the number of parameters in a linear regression model, let $n$ be the number of observations, and let $p>n$. $$\mathbb E[Y\vert X] = \beta_0 +\beta_1X_1 +...+\beta_pX_p$$ Does the Gauss-...
user avatar
  • 31.1k
1 vote
0 answers
15 views

Derivation of residual bivariate expression to find the value for a multiple linear regression coefficient

Could someone help me with this derivation? How do I get to this expression of $k$? $y_i=\beta_0+kT_i+\beta_1X_{1i}+...+\beta_kX_{ki}+u_i$ $k = \frac{Cov(Y_i, \tilde{T_i})}{Var(\tilde{T_i})}$ where $\...
user avatar
  • 113
0 votes
2 answers
32 views

Mathematic modelling vs. machine learning

As a biologist with some background in mathematics I am really interested in mathematical modelling of biological processes, like tumor development or therapy responses. However, looking at recent ...
user avatar
-1 votes
0 answers
38 views

Most marketing channel have negative coefficient in econometrics model for sales?

This is the first time I am working on an econometrics model (Market Mix Modelling) for sales. I have weekly sales data and the number of impressions from various marketing channels like FB, Twitter, ...
user avatar
0 votes
0 answers
24 views

Determining Percentile Ranking of Test Score Given Individual Score, Population Mean, and Standard Deviation

I have recently received an exam grade of 160/200. In addition to this, I have been given the information that the mean score amongst all students was 114.25 and the standard deviation was 45.62. ...
user avatar
3 votes
1 answer
32 views

Why do discrete choice models (such as MNL) not require test set?

The central challenge of Machine learning models is perform well on unseen data. The data is randomly split into train and test set. The test set acts as surrogate for unseen data and is used to ...
user avatar
  • 141
1 vote
1 answer
16 views

sufficient, minimal, complete

Are all complete statistics functions of each other? For example if I have T and S complete statistics Can you always write T in terms of S and S in terms of T?
user avatar
4 votes
1 answer
170 views

variance of the difference of two independent variables is the sum of variances

It is said that variance of the difference of two independent variables is the sum of variances (topic - Confidence intervals. Two means. Independent samples) I tried to experiment with small dataset ...
user avatar
3 votes
0 answers
46 views

Does the likelihood ratio test violate the likelihood principle?

I've been going over Berger's famous example of negative binomial vs binomial sampling leading to two different p-values conditional on the same observed data. To summarize, suppose we observe 9 tails ...
user avatar
  • 51
1 vote
0 answers
35 views

Is it possible to prove that this function of the truncated binomial is decreasing?

Suppose a random variable is binomially distributed with $G$ trials and success probability $p$. Consider the expected proportion of successes, given that the proportion of successes is at least $k$: $...
user avatar
  • 235
0 votes
1 answer
31 views

Are there possibilities to determine 95% confidence interval for right skewed data?

The dataset that I'm using for my thesis is right skewed. It is about lead times (days) I tried log10 transforming it in SPSS but it still does not meet the requirement p>0,05 (Shapiro-wilk). So ...
user avatar
  • 1
0 votes
0 answers
52 views

What is the conditional expectation of two random Poisson variables?

Say I have two random variables $Z^{p}_{i} \mid Y^{p}_{i} \sim \text{Poisson} \left(t^{p}_{i}Y^{p}_{i}\right)$ and $Z^{q}_{i} \mid Y^{q}_{i} \sim \text{Poisson} \left(t^{q}_{i}Y^{q}_{i}\right)$ for ...
user avatar
0 votes
0 answers
28 views

Comparing current and new version of Autoencoder

I am building an LSTM Autoencoder (unsupervised model) to detect anomalies in a time series dataset. The input is telemetry data from routers and I want to detect anomalies in the throughout of ...
user avatar
3 votes
1 answer
34 views

two sample t-test for non-normal population

I assume this question has been beaten to death and thus I am just looking for a reference which goes through the details. Assuming all populations we deal with have finite means and variances (even ...
user avatar
0 votes
0 answers
29 views

What is my best option to evaluate a predictive (or proxy) variable?

I have a list of thunder flashes, and I'm trying to find if a meteorological variable (CAPE) is a good predictable variable (or proxy) for theses flashes. In my thoughts, I want to evaluate this proxy ...
user avatar
0 votes
0 answers
7 views

How to generate a general trend from hundreds of time-series data

I have hundreds of time-series data from individual experiments[2] with a similar trend that reading rises as time goes by (evaluated by my naked eyes). So what statistical tools should I use to ...
user avatar
  • 217
1 vote
0 answers
17 views

Visualization of $L(X)$

Let $L^2_+$ the set of all $2$-dimensional nonnegative random vectors $X = (X_1, X_2)^⊤$ with finite and positive marginal expectations, and let $Ψ^{(2)}$ the class of all measurable functions from $\...
user avatar
  • 111
0 votes
0 answers
20 views

How to find expected value from cumulative distribution function?

Hello everyone, I'm currently doing research based on the model in Competitive fit-revelation sampling and mixed pricing strategy (Wu &Deng, 2021). And I don't understand how they can conclude the ...
user avatar
0 votes
0 answers
19 views

Identification of a pattern based on given features in time-series data

I am working with electricity time-series data collected at 15 minutes intervals. I am looking for a procedure/theory to find the pattern/sequence in the time-series data based on given features. As I ...
user avatar
0 votes
1 answer
66 views

Suppose $X$ and $Y$ have joint pdf $f(x,y) = 0.5,$ for $0 \le x \le 1;$ $0\le y\le2.$ Evaluate $P (Y >X).$

Kind of lost where to start with this. Could be easy but I don't know where to start simply by knowing $f(x, y) = 0.5.$ How can I find the probability $P(Y > X).$
user avatar
0 votes
0 answers
14 views

What is the best statistical test for correlation between 2 ordinal variables? [duplicate]

"1st variable is ranking 2nd is Likert scale I am to correlate the motivation scale (Likert) to job preference (ranking)"
user avatar
  • 1
0 votes
0 answers
39 views

sufficient statistics for bernoulli distribution

Let Y1, . . . , Yn be a random sample of size n where each Yi ~ Bernoulli(p), and let Y = $\sum$ Yi for i = 1, . . . , n. The estimator is W= (Y+1)/(n+2) Is the estimator a sufficient statistics for ...
user avatar
2 votes
1 answer
52 views

Model performance when ground truth is not available

I am building an LSTM Autoencoder (unsupervised model) to detect anomalies in a time series dataset. The input is telemetry data from routers and I want to detect anomalies in the throughout of router....
user avatar
2 votes
1 answer
51 views

Proof that a necessary condition for characteristic roots to lie inside unit circle is $\sum\limits_{i=1}^{n} a_{1} < 1$

I have been trying to show that given $$P_{n}(\alpha) = \alpha^{n} - a_{1}\alpha_{n-1} - a_{2}\alpha^{n-2}... - a_{n} = 0,$$ the $\alpha$'s that solve this equation (real-valued or complex) lie in the ...
user avatar
1 vote
1 answer
19 views

How to test for an "interaction" between two interactions

I plan to apply a LMM with the following structure: Y ~ A1 + A2 + A3 + A1:A2 + A1:A3 + (1|subject). I expect the two interactions to display opposing patterns (...
user avatar
0 votes
0 answers
8 views

Sufficient conditions for equivalence between regression on individual or group average data

I have often hear that running a regression on individual or (properly weighted) aggregated data should give the equivalent results, for example in this question or in Mostly Harmless Econometrics, ...
user avatar
  • 253

1
2 3 4 5
143