# Questions tagged [mathematical-statistics]

Mathematical theory of statistics, concerned with formal definitions and general results.

7,216 questions
Filter by
Sorted by
Tagged with
6 views

### I have troubles with getting a neural network to learn a function [duplicate]

I am currently trying to make an artificial neural network learn a function that takes a 1 dimensional input and the output is also of dimension 1. However, I have some troubles making the network ...
1 vote
41 views

### Different results with different link functions

I have used the R package eventglm to construct pseudo observations, and want to estimate the relative risk and the risk difference for exposure with age adjustment....
19 views

### MLE for Two component mixture model

Chapter 8 section 8.5.1 of the Elements of Statistical Learning book describes a simple mixture model for density estimation and the associated EM algorithm for carrying out maximum likelihood ...
19 views

### Effects of ignoring random effects to type 1 error

I was been told that failing to account for repeated measures can cause more type 1 errors, since sample sizes are over-counted. However, I simulated some data under mix effect model while ignore the ...
1 vote
21 views

### Normality assumption of structural shocks in Vector Autoregression model

I’m currently working on forecasting yield curve evolution over time using a state space model where the transition dynamics are described using a vector autoregressive model of order 1. This model ...
23 views

### What is the variance of the error term for the regression of the sample mean of $x$ on the sample mean of $y$ that is heteroskedastic?

I am having difficulty finding an appropriate expression for the variance of $\bar{e}_{k}$ in $$\bar{y}_{k} = \tilde{\beta} \bar{x}_{k} + \bar{e}_{k}$$ where $i = 1, \dots, n$ individuals from a ...
8 views

### Can distribution of i p-values from regression of Y over Xi provide evidence for/against Xi interactions?

Suppose we have $i$ explanatory variables, and for each of these, we construct a linear model to regress a single dependent variable $Y$ over each explanatory $X_i$. This produces a distribution of $i$...
28 views

### How to choose between one-way, two-anova and multliple regression?

I am working on the data set that consists of Patients' id (after stroke), Time (they can walk after going through the program), the Program they follow and the Visit number when the Time was measured....
30 views

### What is the impact of duplicate data on the variance of regression coefficient? [duplicate]

What is the impact of duplicate data on the variance of the regression coefficient?. Does increasing the size of data always certainly decrease the variance of the model coefficients? Suppose I have ...
49 views

### What is meaning of such notations in general?

I read a notation on a paper about statistics and machine learning ("High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models" by Tengyuan Liang, Subhabrata Sen, and Pragya ...
32 views

### Find asymptotic variance of the moment estimator

I have that $$f(x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}x^2}$$ I have the conditional distribution: $$f_{\beta}(y|x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}(y-\beta_0-\beta_1x-\beta_2x^2)^2}$$ and we ...
30 views

### Derivation of F distribution from quotient distribution

I'm looking for the derivation of the F distribution. There is a fairly understandable (for me) derivation presented on this site: http://www.milefoot.com/math/stat/pdfc-fdist.htm. On this site, the ...
92 views

### In elastic net regularisation, will dividing the OLS term the number of observations cause misleading results when cross-validating?

Two formulations of the elastic net regression function Consider sklearn's implementation of elastic net regularisation (Wikipedia link). From the docs, it works by ...
39 views

### Issue with bounded in probability

I have tried to prove the following problem that I read in the lecture and it seems not transparent to me. Suppose that $Y_{i}$ be independent random variables (with $i=1,2,3, \dotsc$). Each has the ...
7 views

### How to determine how much variation was due to the differences between a group?

I am working on the data set that consists of Patients (after stroke), Time (then can walk after a going through the program), and Program they follow. ... 15 views

### Find fisher information matrix for optimization estimator

I have that $$f(x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}x^2}$$ I have the conditional distribution: $f_{\beta}(y|x)=\frac{1}{\sqrt{2 \pi}}e^{-\frac{1}{2}(y-\beta_0-\beta_1x-\beta_2x^2)^2}$ and we have ...
11 views

### How to have a constant error[b-a] for a range of values [1d array] in decending order that are not linear but are semi-linear?

I am trying to generate n numbers in decending order (for the purpose of decreasing order of weights) such that their sum should be 100 and more importantly the difference between anytwo numbers ...
20 views

### Error Terms in the ANOVA Summary Table

my lecturers require us to write the error term for the effect/source in the ANOVA summary table. Such as below: I don't understand how to find which S(error) term goes to which source. And I do know ...
26 views

### Can somebody help me understand the sentences in more readable expresions?

I was reading a paper about "bayesSimIG" and I have problem in understand the following paragraph.I have read it many times and did a lot of research for it and have understood what each ...
1 vote
40 views

### Proof of statistical assumptions behind the methods or tests

When reading statistics literature, they provide the assumptions of when specific tests/methodologies can be used. Take factor analysis as an example; you may find this inside a paper: "Generally ...
17 views

### Is there a boundary between statistical and machine learning methods?

I want to better understand what exactly is considered "machine learning" or not. I realize there might not be a categorical answer for this, but that's what I want to understand. ...
52 views

### football probability

I have the following problem: Suppose that the probability of a football team (T) to win the match with 2-1 is p1 and, given that T scores a goal, the probability that the best player of the team ...
18 views

33 views

### Mathematic modelling vs. machine learning

As a biologist with some background in mathematics I am really interested in mathematical modelling of biological processes, like tumor development or therapy responses. However, looking at recent ...
24 views

### Determining Percentile Ranking of Test Score Given Individual Score, Population Mean, and Standard Deviation

I have recently received an exam grade of 160/200. In addition to this, I have been given the information that the mean score amongst all students was 114.25 and the standard deviation was 45.62. ...
38 views

### Why do discrete choice models (such as MNL) not require test set?

The central challenge of Machine learning models is perform well on unseen data. The data is randomly split into train and test set. The test set acts as surrogate for unseen data and is used to ...
18 views

### sufficient, minimal, complete

Are all complete statistics functions of each other? For example if I have T and S complete statistics Can you always write T in terms of S and S in terms of T?
182 views

### variance of the difference of two independent variables is the sum of variances

It is said that variance of the difference of two independent variables is the sum of variances (topic - Confidence intervals. Two means. Independent samples) I tried to experiment with small dataset ...
49 views

### Does the likelihood ratio test violate the likelihood principle?

I've been going over Berger's famous example of negative binomial vs binomial sampling leading to two different p-values conditional on the same observed data. To summarize, suppose we observe 9 tails ...
1 vote
35 views

22 views

### How to find expected value from cumulative distribution function?

Hello everyone, I'm currently doing research based on the model in Competitive fit-revelation sampling and mixed pricing strategy (Wu &Deng, 2021). And I don't understand how they can conclude the ...
24 views

### Identification of a pattern based on given features in time-series data

I am working with electricity time-series data collected at 15 minutes intervals. I am looking for a procedure/theory to find the pattern/sequence in the time-series data based on given features. As I ...
70 views

### Suppose $X$ and $Y$ have joint pdf $f(x,y) = 0.5,$ for $0 \le x \le 1;$ $0\le y\le2.$ Evaluate $P (Y >X).$

Kind of lost where to start with this. Could be easy but I don't know where to start simply by knowing $f(x, y) = 0.5.$ How can I find the probability $P(Y > X).$
18 views

### What is the best statistical test for correlation between 2 ordinal variables? [duplicate]

"1st variable is ranking 2nd is Likert scale I am to correlate the motivation scale (Likert) to job preference (ranking)"
71 views

### sufficient statistics for bernoulli distribution

Let Y1, . . . , Yn be a random sample of size n where each Yi ~ Bernoulli(p), and let Y = $\sum$ Yi for i = 1, . . . , n. The estimator is W= (Y+1)/(n+2) Is the estimator a sufficient statistics for ...
91 views

### Model performance when ground truth is not available

I am building an LSTM Autoencoder (unsupervised model) to detect anomalies in a time series dataset. The input is telemetry data from routers and I want to detect anomalies in the throughout of router....
### Proof that a necessary condition for characteristic roots to lie inside unit circle is $\sum\limits_{i=1}^{n} a_{1} < 1$
I have been trying to show that given $$P_{n}(\alpha) = \alpha^{n} - a_{1}\alpha_{n-1} - a_{2}\alpha^{n-2}... - a_{n} = 0,$$ the $\alpha$'s that solve this equation (real-valued or complex) lie in the ...