# All Questions

1k views

### SVD of correlated matrix should be additive but doesn't appear to be

I'm just trying to replicate a claim made in the following paper, Finding Correlated Biclusters from Gene Expression Data, which is: Proposition 4. If $X_{IJ}=R_{I}C^{T}_{J}$. then we have: ...
358 views

### Can the Mantel test be extended to asymmetric matrices?

The Mantel test is usually applied to symmetric distance/difference matrices. As far as I understand, an assumption of the test is that the measure used to define differences must be at least a ...
1k views

329 views

### Why does the scikit-learn bootstrap function resample the test set?

When using bootstrapping for model evaluation, I always thought the out-of-bag samples were directly used as a test set. However, this appears not to be the case for the scikit-learn bootstrap ...
177 views

### State-of-the-art in deduplication

What are the state-of-the-art methods in record deduplication? Deduplication is also sometimes called: record linkage, entity resolution, identity resolution, merge/purge. I know for example about ...
618 views

### Contrast matrix definition

What exactly is contrast matrix and how exactly is contrast matrix specified? I.e. what are columns, what are rows, what are the constraints on that matrix and what does number in column ...
389 views

### Link Anomaly Detection in Temporal Network

I came across this paper that uses link anomaly detection to predict trending topics, and I found it incredibly intriguing: The paper is "Discovering Emerging Topics in Social Streams via Link Anomaly ...
3k views

### Unable to fit negative binomial regression in R (attempting to replicate published results)

Attempting to replicate the results from the recently published article, Aghion, Philippe, John Van Reenen, and Luigi Zingales. 2013. "Innovation and Institutional Ownership." American Economic ...
173 views

### Penalized spline confidence intervals based on cluster-sandwich VCV

This is my first post here, but I've benefited a lot from this forum's results popping up in google search results. I've been teaching myself semi-parametric regression using penalized splines. ...
372 views

### Physical/pictoral interpretation of higher-order moments

I'm preparing a presentation about parallel statistics. I plan to illustrate the formulas for distributed computation of the mean and variance with examples involving center of gravity and moment of ...
87 views

### Statistical test for one paired observation

In this question, @whuber writes in his reply that If you were willing to assume something about that common distribution (such as it is some Normal distribution--but without knowing or assuming ...
105 views

### Can you use the Kolmogorov-Smirnov test to directly test for equivalence of two distributions?

There has been talk on other questions of how one might use the Two One-Sided Tests (TOST) approach for the Kolmogorov-Smirnov (KS) test, but I was wondering whether it was possible to directly use ...
86 views

### 10 % false positives from nonlinear mixed effect models : Why?

I've run a simulation study in order to estimate type I error rate of the test of group effect in a nonlinear mixed effects model, using nlmer from lme4 package. The results show there is 8-10 % ...
78 views

### Tail of the inverse cdf

I am almost sure I have already seen the following result in statistics but I can't remember where. If $X$ is a positive random variable and $E(X)<\infty$ then $\epsilon F^{-1}(1-\epsilon) \to 0$ ...
240 views

### Blind source separation of convex mixture?

Suppose I have $n$ independent sources, $X_1, X_2, ..., X_n$ and I observe $m$ convex mixtures: \begin{align} Y_1 &= a_{11}X_1 + a_{12}X_2 + \cdots + a_{1n}X_n\\ ...&\\ Y_m &= a_{m1}X_1 + ...
2k views

### Trouble finding good model fit for count data with mixed effects - ZINB or something else?

I have a very small data set on solitary bee abundance that I am having trouble analysing. It’s count data, and almost all the counts are in one treatment with most of the zeroes in the other ...
550 views

### Comparing regression coefficients of same model across different data sets

I'm evaluating two (2) refrigerants (gases) that were used in the same refrigeration system. I have saturated suction temperature ($S$), condensing temperature ($D$), and amperage ($Y$) data for the ...
366 views

### When an analytical Jacobian is available, is it better to approximate the Hessian by $J^TJ$, or by finite differences of the Jacobian?

Let's say I'm computing some model parameters my minimizing the sum squared residuals, and I'm assuming my errors are Gaussian. My model produces analytical derivatives, so the optimizer does not need ...
205 views

### Bound for Arithmetic Harmonic mean inequality for matrices?

NOTE: This question has originally been posted in MSE, but it did not generate any interest. It was first posted there, because the question itself is a pure matrix-algebra question. Nevertheless, ...
193 views

### Analyze a football match: similar players with DBSCAN and similar trajectories with TRACLUS

I'm trying to analyze a dataset that originates from sensors located near players' shoes in a match (http://www.orgs.ttu.edu/debs2013/index.php?goto=cfchallengedetails). I decided to look at ...
300 views

### Luce choice axiom, question about conditional probability

I'm reading Luce (1959). Then I found this statement: When a person chooses among alternatives, very often their responses appear to be governed by probabilities that are conditioned on the ...
498 views

### Tail inequality on sum of product of normal variables

For independent random variables $x_1,..,x_n$ and $y_1,...,y_n$ following normal distribution $N(0,1)$, I need a simple estimate formula for $P(| \sum_1^n x_iy_i | \leq nt ) \leq e^{(?)}$ for ...
140 views

### Identification of parameters problem

I always struggle to get the true essence of identification in econometrics. I know that we state that a parameter (say $\hat{\theta}$) can be identified if by simply looking at its (joint) ...
412 views

### Can these data be aggregated into a proportion for a binomial glm?

We asked 60 people to list as many restaurant franchises in Atlanta as they could. The overall list included over 70 restaurants, but we eliminated those that were mentioned by fewer than 10% of the ...
264 views

### Can I use optimally scaled variables for a factor analysis to account for rotation? If I can then how?

I have discussed this issue several times in this site, but I am asking it again for a final justification from the experts of our community. I wanted to extract four factors (I should call dimensions ...
240 views

### What is Shannon's source entropy?

Suppose that ${X_n; Y_n}$ is a random process with a discrete alphabet, that is, taking on values in a discrete set for $n$ data length. They correspond to the input and output of a communication ...
732 views

### Simulating time-series given power and cross spectral densities

I am having trouble generating a set of stationary colored time-series, given the covariance matrix (their PSDs and CSDs). I know that, given two time-series $y_{I}(t)$ and $y_{J}(t)$, I can ...
266 views

### Distribution of inverse Wishart to a power?

In a related question, I had asked about the norm induced by an inverse Wishart matrix. I am interested in generalizing that result somewhat. Let $A\sim\mathcal{W}_p\left(I,n\right)$, a Wishart matrix ...
96 views

### Estimation and functional space

In the first chapter of the book Algebraic Geometry and Statistical Learning Theory which talks about the convergence of estimations in different functional space, it mentions that the Bayesian ...
914 views

### Link between variance and pairwise distances within a variable

Please, prove that if we have two variables (equal sample size) $X$ and $Y$ and the variance in $X$ is greater than in $Y$, then the sum of squared differences (i.e., squared euclidean distances) ...
255 views

### Standard error of sample standard deviation of proportions

I recently started reading Gelman and Hill's, "Data Analysis Using Regression and Multilevel/Hierarchical Models" and the question is based on that: The sample contains 6 observations on proportions: ...
824 views

### How do I algorithmically determine values of T1 & T2 for canopy clustering?

I am trying to use canopy clustering to provide initial clusters for KMeans in mahout. Is there a way to determine / approximate the values of the distance thresholds T1 & T2 algorithmically? ...
1k views

### How to use G Power 3 to calculate statistical power in mixed design ANOVA with unequal group sample sizes

In G power 3, ANOVA repeated measures within-between interaction: Only the total sample size is reported assuming equal sample size for the two groups. My questions are: How would it work if the ...
Suppose $X\sim InvWishart(\nu, \Sigma_0)$. I'm interested in the marginal distribution of the diagonal elements $diag(X) = (x_{11}, \dots, x_{pp})$. There are a few simple results on the distribution ...