Mathematical theory of statistics, concerned with formal definitions and general results.

learn more… | top users | synonyms (1)

0
votes
0answers
33 views

Help logistic regression [on hold]

I have to predict a binary variable with logistic regression. The idea is to classify a number of subjects each either sick or not sick. Therefore, I have 11 risk factories for each person and have to ...
1
vote
1answer
20 views

Why pnorm function and sum of dnorm function differs for same input?

Data is height of men in 'inches'. Mean is 70. SD is 3.3 I wanted to compute the probability of men whose height is in between 69 inches and 74 inches. The following methods gave me different ...
2
votes
3answers
63 views

Understanding Sampling with replacement

I am doing Stat110 and in the book, "Introduction to Probability" they give the following definition of sampling with replacement: Theorem 1.4.5 (Sampling with replacement). Consider n objects and ...
0
votes
0answers
29 views

How to design an economic index?

I'm designing a linear economic index: $I_{t}=W_{1} X_{t_{1}}+W_{2}X_{t_{2}}+W_{3}X_{t_{3}}$ where $W_{1}$ to $W_{3}$ are weights of inputs ($X_{t_{1}}$ to $X_{t_{3}}$) and $I_{t}$ is the final ...
3
votes
1answer
56 views

Most accepted theory to analyse trend in data series

I have pollutant concentration for long period I want to determine trend. I have read some of the question answers in this blog regarding same . I have few queries. What is most accepted theory to ...
0
votes
0answers
25 views

Multinomial distribution pdf and fisher information matrix

The question is from Robert Hogg etal's Introduction to Mathematical Statistics 6th Edition Page 347 Example 6.4.5. It says: Consider a random trial which can result in one, and only one, of k ...
2
votes
0answers
33 views

Estimating probability distribution function of data stream

Although a similar question exists, I couldn't find my answer. I'm not a statistician hence please neglect if some terminologies aren't correct and let me know if I am interpreting something wrong. ...
3
votes
1answer
42 views

Spatial autoregressive model implementation in R

I need to implement a SAR model with no covariates. To be more specific, the regression I have to estimate is y=bWy+e where: y is the dependent variable; b is the coefficient parameter to be ...
0
votes
0answers
14 views

Cross Validation and Logistic Regression

Cross Validation-validation, Over Fitting over-fitting, Logistic Regression and logistic regression (restrictedI am restricted to using SAS only) I have a data set of 60 000 records (binary ...
7
votes
1answer
121 views

Mechanics behind deviation from random distribution

The system we are working on is biological, more specifically the distribution of programmed DNA damage events across a chromosome. This can be thought of as 1D array (the chromosome) across which ...
0
votes
0answers
12 views

Statistically test difference based on time series

Usually in statistical hypothesis testing, we randomly split some unit into treatment group and control group, and we test if there are difference between treatment group and control group based on a ...
0
votes
0answers
28 views

Cross-validation, over-fitting, and logistic regression

(I am restricted to using SAS only) I have a data set of 60 000 records (binary response, roughly 90 continuous predictors ... the data set is full of legitimate zeros, so I am analyzing the ...
-1
votes
1answer
57 views

General formula for finding covariance of monomials of multivariate random variables

Suppose that we have independent random variables $X_1,X_2,X_3$ which are gaussian multivariate distributed with a mean of zero vector and a diagonal covariance matrix. $X=[X_1,X_2,X_3] \tilde{} N(0, ...
-1
votes
1answer
51 views

Applying the T-test [closed]

So far I have calculated the sample means $\overline{A} = 0.75$ and $\overline{B} = 2.33$. Using these I computed the sample variances: $S_A^2 \approx \frac{28.805}{9} = 3.2005$ and $S_B^2 = ...
1
vote
1answer
26 views

A question on notation in the least squares method

I am reading some nice lecture notes on basic statistics, learning some basic topics on estimation of parameters. Reading the chapter about the method of least squares estimation I meet the following ...
0
votes
0answers
19 views

How to compute the average of the relative weightings?

I have the following problem. I have a sample of daily snapshots of a portfolio grouped by four asset classes: Forex, Futures, Options and Equities. For each day in my sample I compute the weight of ...
3
votes
1answer
49 views

Variance stabilisation

$Y$ has mean $\mu$ and variance function $V(\mu)$. If $V(\mu) = \alpha.\mu^v$ then $h(y) = y^{(2-v)/2}$ is variance stabilising which means that $Var(h(Y))$ is approximately constant. I tried to ...
0
votes
0answers
11 views

Reducing model weight increases accuracy

I have a question. Say i have 3 class labels 1,2,3 Basically, i have about 1 million examples of 1, 1000 examples of 2 and 3 each. Hence, the weight of my label 1 would be 0.001, 2 would be 1 and ...
3
votes
0answers
22 views

Bound on the total change using Pearson's r

I am given an increasing series $(x_1,....x_n)$ and I know the pearson correlation between $(x_1,....x_n)$ and some (unknown) increasing series $(y_1,....y_n)$. Can I derive an upper and a lower ...
2
votes
0answers
22 views

Is there any alternative to the EM algorithm?

I am working on biomedical signal analysis and the most used method for parameters estimation is the EM algorithm. My question is : what are the most powerful alternatives to this algorithm?
0
votes
0answers
10 views

Creating a decay function to time series data

Here is the challenge. I am measuring performance of an entity each day going back a year. The performance metric (score) is a number between 0 and 1. So it looks something like this, where day is ...
0
votes
0answers
9 views

binomial error calculated with formula

i have uploaded a 2D histogram ,, actually it is filled by dividing two 2Dhistograms with same bins.i want to calculate manually each error which is shown with each value i.e binContent.Please ...
0
votes
1answer
55 views

Comparing failure rates between 2 products with different number of deployed equipment

I have the following scenario, which I am trying to better understand. There are 2 different brands or groups of devices performing the same functionality as such: - Product/Brand 1 has 4,323 devices ...
1
vote
1answer
26 views

Biased and Efficient estimators

Is unbiasedness a necessary condition for an estimator to be efficient? For example, if $\hat {\theta}= \frac{\sum_i^n X_i}{3}$, I assume $\hat {\theta}$ can't be efficient in a Cramer-Rao lower ...
1
vote
0answers
75 views

Error in linear regression

Given two series $(x_1,...x_n)$ and $(y_1,...y_n)$, and assume that we know $x_{n+1}$. Given the fact that the pearson correlation won't change in the next observation of $y_{n+1}$, can we bound the ...
3
votes
1answer
63 views

What is the value of $\mu_0$ and $\kappa_0 $in $N(\mu_0,\sigma / \kappa_0)$?

In a Bayesian analysis I want to sample $\sigma \sim \text{inverse-Wishart}(\nu_0,M)$ where $\nu_0$ is the degrees of freedom, equal to dimension+1 and $M$ is a scalar matrix Then I will sample the ...
2
votes
0answers
24 views

What does improper learning mean in the context of statistical learning theory and machine learning?

I was reading the following paper and it talked about improper learning. I wasn't 100% what it rigorously meant but they do mention: I am not sure what "representation independent" means, but as ...
0
votes
3answers
46 views

A hypothesis test question

Let $X_i$ (for all integer $i$)be Bernoulli random variables (which takes either value -1 or 1, with equal probability). Define a random variable $Y$ to be $Y=\sum_{i=1}^d{X_i}$, where $d$ is a hidden ...
0
votes
0answers
31 views

Cointegration and variance of time series

If we know that $X_t , Y_t$ are two cointegrated discrete random processes, what can we say about the relationship between variance of the two increments $var(X_{t+h}-X_t)$ , $var(Y_{t+h}-Y_t)$ for a ...
0
votes
1answer
23 views

How to compare 2 ARIMA model predictions using mean squared prediction error

How can I compare the predictions of 2 arima models using mean square prediction error in R, given that I know what the observed values are. Help greatly appreciated.
5
votes
1answer
45 views

Is it possible to calculate Q1, Median, Q3, StDev from already aggregated data?

We have data that will get aggregated per hour into the following values Q1 Median Mean Q3 Standard Deviation Max Min Count of Values So the data will look more or like this in the end. ...
2
votes
1answer
32 views

two tailed unequal variance t-test

Can someone explain to me what is the null hypothesis of the two tailed unequal variance t-test in the below: My understanding is the following: The statement states: "The duration times for the ...
4
votes
2answers
92 views

Linear graph turning exponential at a particular point

For a line graph, it behaves linearly upto a particular point and varies exponentially after it. Please suggest me a statistical approach/test to know this threshold point. When I plot a scatter ...
1
vote
1answer
45 views

Can a truly randomized procedure (e.g. random treatment allocation) result in unbalanced distributions?

Thousands of randomized trials are ongoing or in the planning. These trials rely on randomization procedures (e.g. patients being randomized to either placebo or active drugs) to yield two balanced ...
0
votes
0answers
8 views

Usual way of measuring a set's deviation from another set

I have a set of reference daily prices. I also use an algorithm to estimate daily prices. I want to measure the difference between my estimations and the reference. I am quite unfamiliar with ...
3
votes
0answers
43 views

Sufficient statistics and UMVUE for joint poisson, bernoulli

Given a pair $(X,Y)$ of r.v.s such that: $$X \sim \text{Poisson}(\lambda)\quad \text{and}\quad Y \sim B(\frac{\lambda}{1+\lambda})$$ with $X,Y$ independent, determine a one-dimensional ...
4
votes
1answer
36 views

How to find maximum likelihood of multiple exponential distributions with different parameter values

Let's say that I have a bunch of independent samples, $X_1, X_2, \dots, X_n$ and that they all follow Exponential($\theta_i$) distributions. (So they all have pdf $f(x_i)=\theta_i\exp(-\theta_iy_i)$.) ...
0
votes
0answers
41 views

Transform sum of gamma distribution to chi square distribution

Let's say that I have a random sample $Y_1, Y_2, \dots, Y_n \sim\Gamma(\alpha, \theta)$. I can work out using the moment generating function that the distribution of $\sum Y_i$ is $\Gamma(n\alpha, ...
5
votes
1answer
52 views

Foundational sufficient statistics

I've been reading through Casella and Berger's Statistical Infererence and have am having a little trouble understanding something in their explanation of sufficient statistics. Here is the passage ...
43
votes
9answers
2k views

Are we exaggerating importance of model assumption and evaluation in an era when analyses are often carried out by laymen

Bottom line, the more I learn about statistics, the less I trust published papers in my field; I simply believe that researchers are not doing their statistics well enough. I'm a layman, so to ...
0
votes
1answer
79 views

Understanding Fisher Information for vector parameters

Assume that we have a vector parameter $a = [a_1^T \, a_2^T]^T$. I need help to understand the difference between the conditional Fisher information $FI_{a_1|a_2}$ and the regular Fisher information ...
2
votes
1answer
247 views

How does the mean function work for a Gaussian Process?

I was reading the notes on Gaussian Processes by Choung B. Do (stanford course CS229) however was unsure of how the mean function worked and what a random variable was on the Gaussian Process So ...
2
votes
0answers
275 views

Uniform most powerful Test for one-sided hypothesis

I am looking at the proof of the following theorem from Morris H. DeGroot and Mark J. Schervish's probability and statistics. I am having trouble in understanding part of the proof, which I have ...
1
vote
2answers
68 views

Normalizing matrix values python/R

I am trying to fill missing values in 1000 x 1000 matrices. Dataset1 contains such 1000 x 1000 matrice with value ranging 1-100. ...
0
votes
1answer
19 views

Unbiased estimator and variance

A random sample of n people are asked whether they are against smoking or not. Suppose x are against smoking. What is the distribution of the random variable X (number of those against smoking). State ...
1
vote
2answers
57 views

Samples from a multivariate t distribution

Hi I have the following problem. I draw a sample of a multivariate t-distribution with some fixed covariance matrix, so that the realizations are correlated, and $\nu=4$. Now I repeat this $n$ times, ...
1
vote
1answer
69 views

Matrix Multiplication to find Correlation Matrix

In this book on matrix factorizations: http://lnfm1.sai.msu.ru/~rastor/Books/Skillicorn-Understanding_complex_datasets_data_mining_with_matrix_decompositions.pdf The author states the following ...
2
votes
1answer
40 views

Efficiency becomes 0 when sample size becomes big?

I am trying to solve Robert Hogg's mathematical anaysis 6th exercise 6.2.11. The problem says. Let $\bar{X}$ be the mean of a random sample of size n from a $N(\theta,\sigma^2)$ distribution, ...
1
vote
1answer
32 views

Mathematical Basis behind inflation of Standard errors of Regression estimates due to multicollinearity

We know that due to multi-collinearity, the standard errors of beta estimates get inflated. But what is the mathematical basis to it? I am looking for some mathematical relationship or something to ...
0
votes
0answers
17 views

Statistical comparison

Im going to test my dataComparison on steganographic images(lossy and lossless) on a large number of samples. I would like ...