# All Questions

1k views

### SVD of correlated matrix should be additive but doesn't appear to be

I'm just trying to replicate a claim made in the following paper, Finding Correlated Biclusters from Gene Expression Data, which is: Proposition 4. If $X_{IJ}=R_{I}C^{T}_{J}$. then we have: ...
388 views

### Can the Mantel test be extended to asymmetric matrices?

The Mantel test is usually applied to symmetric distance/difference matrices. As far as I understand, an assumption of the test is that the measure used to define differences must be at least a ...
2k views

235 views

### Degrees of freedom of $\chi^2$ in Hosmer-Lemeshow test

The test statistic for the Hosmer-Lemeshow test for goodness of fit of a logistic regression model is defined as follows: the sample is split into $d=10$ deciles, $D_1, D_2, \dots , D_{d}$, per ...
214 views

### In statistical learning theory, isn't there a problem of overfitting on a test set?

Let's consider the problem about classifying the MNIST dataset. According to Yann LeCun's MNIST Webpage, 'Ciresan et al.' got 0.23% error rate on MNIST test set using Convolutional Neural Network. ...
219 views

### Help in how the paper derives the CRLB for Gaussian ARMA model

An univariate autoregressive process AR(p) process is expressed as $$y(n) = \sum_{j=1}^p a_jy(n-j) + u(n)$$ is excited by Gaussian sequence, $u$. Paper : On the Computation of the Cramer-Rao Bound ...
2k views

### How to analyze longitudinal count data: accounting for temporal autocorrelation in GLMM?

Hello statistical gurus and R programming wizards, I am interested in modeling animal captures as a function of environmental conditions and day of the year. As part of another study, I have counts ...
272 views

### Fisher information in a hierarchical model

Given the following hierarchical model, $$X \sim {\mathcal N}(\mu,1),$$ and, $$\mu \sim {\rm Laplace}(0, c)$$ where $\mathcal{N}(\cdot,\cdot)$ is a normal distribution. Is there a way to get an ...
151 views

### What is the meaning of the eigenvectors of a mutual information matrix?

When looking at the eigenvectors of the covariance matrix, we get the directions of maximum variance (the first eigenvector is the direction in which the data varies the most, etc.); this is called ...
197 views

### State-of-the-art in deduplication

What are the state-of-the-art methods in record deduplication? Deduplication is also sometimes called: record linkage, entity resolution, identity resolution, merge/purge. I know for example about ...
390 views

### Model selection with Firth logistic regression

In a small data set ($n\sim100$ ) that I am working with, several variables give me perfect prediction/separation. I thus use Firth logistic regression to deal with the issue. If I select the best ...
399 views

### Link Anomaly Detection in Temporal Network

I came across this paper that uses link anomaly detection to predict trending topics, and I found it incredibly intriguing: The paper is "Discovering Emerging Topics in Social Streams via Link Anomaly ...
1k views

### Intraclass Correlation Coefficients (ICC) with Multiple Variables

Suppose I have measured some variable in siblings, which are nested within families. The data structure looks like this: family sibling value ------ ------- ----- 1 1 y_11 1 2 ...
174 views

### What graphical methods are useful for visualising how uncertainties aggregate?

I have a set of systems where uncertainties accumulate within it. These aren't always purely additive - sometimes they are, sometimes they aren't. I've had some success in using fan-charts, bar charts ...
70 views

### Jaynes' $A_p$ distribution

In Jaynes' book "Probability Theory: The Logic of Science", he has a chapter (Ch 18) entitled "The $A_p$ distribution and rule of succession" in which he introduces the idea of $A_p$ distribution; ...
413 views

### Why does the scikit-learn bootstrap function resample the test set?

When using bootstrapping for model evaluation, I always thought the out-of-bag samples were directly used as a test set. However, this appears not to be the case for the scikit-learn bootstrap ...
273 views

### Modeling prior probability as a delta function

I'm using approximate Bayesian computation to find the true value of a parameter. My prior distribution is uniform over $(0, 1)$. I was watching this video on Bayesian learning and the lecturer ...
217 views

### Bound for Arithmetic Harmonic mean inequality for matrices?

NOTE: This question has originally been posted in MSE, but it did not generate any interest. It was first posted there, because the question itself is a pure matrix-algebra question. Nevertheless, ...
218 views

### Analyze a football match: similar players with DBSCAN and similar trajectories with TRACLUS

I'm trying to analyze a dataset that originates from sensors located near players' shoes in a match (http://www.orgs.ttu.edu/debs2013/index.php?goto=cfchallengedetails). I decided to look at ...
178 views

### Penalized spline confidence intervals based on cluster-sandwich VCV

This is my first post here, but I've benefited a lot from this forum's results popping up in google search results. I've been teaching myself semi-parametric regression using penalized splines. ...
1k views

### What prior distributions could/should be used for the variance in a hierarchical bayesisan model when the mean variance is of interest?

In his widely cited paper Prior distributions for variance parameters in hierarchical models (916 citation so far on Google Scholar) Gelman proposes that good non-informative prior distributions for ...
383 views

### Physical/pictoral interpretation of higher-order moments

I'm preparing a presentation about parallel statistics. I plan to illustrate the formulas for distributed computation of the mean and variance with examples involving center of gravity and moment of ...
112 views

### Geometric understanding of PCA in the subject (dual) space

I am trying to get an intuitive understanding of how principal component analysis (PCA) works in subject (dual) space. Consider 2D dataset with two variables, $x_1$ and $x_2$, and $n$ data points ...
89 views

### 10 % false positives from nonlinear mixed effect models : Why?

I've run a simulation study in order to estimate type I error rate of the test of group effect in a nonlinear mixed effects model, using nlmer from lme4 package. The results show there is 8-10 % ...
105 views

### Tail of the inverse cdf

I am almost sure I have already seen the following result in statistics but I can't remember where. If $X$ is a positive random variable and $E(X)<\infty$ then $\epsilon F^{-1}(1-\epsilon) \to 0$ ...
145 views

### A question related to Borel-Cantelli Lemma

Note: Borel-Cantelli Lemma says that $$\sum_{n=1}^\infty P(A_n) \lt \infty \Rightarrow P(\lim\sup A_n)=0$$ \sum_{n=1}^\infty P(A_n) =\infty \textrm{ and } ...
195 views

### ANOVA: testing assumption of normality for many groups with few samples per group

Assume the following situation: we have a large number (e.g. 20) with small group sized (e.g. n = 3). I noticed that if I generate values from the uniform distribution, the residuals will look ...
243 views

### Blind source separation of convex mixture?

Suppose I have $n$ independent sources, $X_1, X_2, ..., X_n$ and I observe $m$ convex mixtures: \begin{align} Y_1 &= a_{11}X_1 + a_{12}X_2 + \cdots + a_{1n}X_n\\ ...&\\ Y_m &= a_{m1}X_1 + ...
2k views

### Trouble finding good model fit for count data with mixed effects - ZINB or something else?

I have a very small data set on solitary bee abundance that I am having trouble analysing. It’s count data, and almost all the counts are in one treatment with most of the zeroes in the other ...
593 views

### Comparing regression coefficients of same model across different data sets

I'm evaluating two (2) refrigerants (gases) that were used in the same refrigeration system. I have saturated suction temperature ($S$), condensing temperature ($D$), and amperage ($Y$) data for the ...
59 views

### Example Of Strict von Neumann Inequality

Let $r(\pi, \delta)$ denote the Bayes risk of an estimator $\delta$ with respect to a prior $\pi$, let $\Pi$ denote the set of all priors on the parameter space $\Theta$, and let $\Delta$ denote the ...
404 views

### Algorithm for real-time normalization of time-series data?

I'm working on an algorithm that takes in a vector of the most recent data point from a number of sensor streams and compares the euclidean distance to previous vectors. The problem is that the ...
311 views

### Luce choice axiom, question about conditional probability

I'm reading Luce (1959). Then I found this statement: When a person chooses among alternatives, very often their responses appear to be governed by probabilities that are conditioned on the ...
330 views

### Understanding Sequential Probability Ratio Test (SPRT) Likelihood Ratio

I am a software developer looking to develop an alternative for the simple hypothesis testing scheme described here. In short, the test works as follows: Two URLs are compared for their ability to ...
439 views

### What is meant by the “level” of a time series?

In much of the literature I'm studying it's one of those terms that occurs frequently yet without a rigorous definition to be found. Specifically, I am told: For time-indexed random variables ...
537 views

### Tail inequality on sum of product of normal variables

For independent random variables $x_1,..,x_n$ and $y_1,...,y_n$ following normal distribution $N(0,1)$, I need a simple estimate formula for $P(| \sum_1^n x_iy_i | \leq nt ) \leq e^{(?)}$ for ...
142 views

### Identification of parameters problem

I always struggle to get the true essence of identification in econometrics. I know that we state that a parameter (say $\hat{\theta}$) can be identified if by simply looking at its (joint) ...
431 views

### Can these data be aggregated into a proportion for a binomial glm?

We asked 60 people to list as many restaurant franchises in Atlanta as they could. The overall list included over 70 restaurants, but we eliminated those that were mentioned by fewer than 10% of the ...
274 views

### Can I use optimally scaled variables for a factor analysis to account for rotation? If I can then how?

I have discussed this issue several times in this site, but I am asking it again for a final justification from the experts of our community. I wanted to extract four factors (I should call dimensions ...
263 views

### What is Shannon's source entropy?

Suppose that ${X_n; Y_n}$ is a random process with a discrete alphabet, that is, taking on values in a discrete set for $n$ data length. They correspond to the input and output of a communication ...
766 views

### Simulating time-series given power and cross spectral densities

I am having trouble generating a set of stationary colored time-series, given the covariance matrix (their PSDs and CSDs). I know that, given two time-series $y_{I}(t)$ and $y_{J}(t)$, I can ...
275 views

### Distribution of inverse Wishart to a power?

In a related question, I had asked about the norm induced by an inverse Wishart matrix. I am interested in generalizing that result somewhat. Let $A\sim\mathcal{W}_p\left(I,n\right)$, a Wishart matrix ...
778 views

### Is the Binomial Effect Size Display (BESD) usually an unsound, misleading technique?

It's hard for me to accept that Donald Rubin would ever come up with a true lemon of a technique. Yet that's my perception of the BESD [1, 2], 3]3. He and Robert Rosenthal (1982*) claimed that there ...
99 views

### Estimation and functional space

In the first chapter of the book Algebraic Geometry and Statistical Learning Theory which talks about the convergence of estimations in different functional space, it mentions that the Bayesian ...
Please, prove that if we have two variables (equal sample size) $X$ and $Y$ and the variance in $X$ is greater than in $Y$, then the sum of squared differences (i.e., squared euclidean distances) ...