# Questions tagged [computational-statistics]

Refers to the interface of statistics and computing; the use of algorithms and software for statistical purposes.

659 questions
Filter by
Sorted by
Tagged with
20 views

### Fast top-n from samples of many different normal distributions

Let's say I have 1 million normal distributions, each with a different mean and stdev. I want to sample from each distribution and take the top 10 samples (for a Thompson sampling application.) Is ...
28 views

18 views

### Biplot interpretation

I'm quite confused as to interpreting results from a biplot. I am trying to find out which variable is negatively correlated with the variable Hue and which variable is uncorrelated with Hue. At this ...
43 views

### I have a group that contains zero data, and I want to know whether it is considered normally or not normally distributed.?

I have a group (group2) that contains zero data, and I want to know whether it is considered normal or not normally distributed. I used the SPSS software, and it showed this result. I also tried R, ...
21 views

### How do I solve skewness in a percentage difference calculation?

I have two variables I want to evaluate -- Planned Hours per project and Tracked Hours per project. Sometimes Planned Hours exceeds Tracked Hours, but often it's the reverse. I calculated the ...
32 views

### Efficient storage of functional data

I have access to a sample (size $N$) of functional data. Each observation corresponds to $C$ functions. Each function $f_{n,c}$ is represented by $T_n$ points for $1\geq n \geq N, 1\geq c \geq C$. All ...
38 views

### What are some well-known unbiased estimator of regression coefficient besides OLS estimator?

Is there any other unbiased estimator of regression coefficient than OLS? For instance, one might consider using unbiased estimator with less computational cost (since OLS involves matrix inversion)?
1 vote
9 views

### General way to describe dot product of N different random variables [duplicate]

I'm a novice to DS, so feel free to correct me. Imagine we have $N$ biased coins each with different probability of getting heads (which are known to us prior). What's the probability of getting $k$ ...
543 views

### Antithetic method for monte carlo when bounds of the integral are infinite

I wanted to apply Monte Carlo with antithetic variables to estimate $\int_{0}^{\infty} e^{-x} \,dx$ (equal to 1). I used this R code. ...
37 views

### What reasons beyond interpretability are there to use additive models over a complex, multivariate smoother?

Let's adopt for the second the notation from the R package mgcv. ...
11 views

### How to decompose multiple periodicities present in the data without specifying the period?

I am trying to decompose the periodicities present in a signal into its individual components. Say the following is my signal: You can reproduce the signal using the following code: ...
1 vote
78 views

### Can I make Stata run lasso faster?

I am trying to run a lasso in Stata. I have 1.5 million observations and 1700 variables. Stata is running too slow. I am in 36th grid after 4 days. And get slower ever grid. I am using a 98GB Memory, ...
9 views

### KS-Test Mutual Independence Assumption Question

I am trying to test whether a distribution of data (intensities of a region in an image) follow a uniform distribution of the same range of value: ...
1 vote
11 views

I have a data set with 32 variables. Of those, I find two principal components. I then took the difference between principal components and I would like to find the loading of the difference between ...
64 views

### Are the distances on a hierarchical clustering dendrogram in the same units as the input distance matrix?

I use Aitchison distance as the input to a hierarchical clustering dendrogram. I started labeling and interpreting the dendrogram but wasn't sure about a few aspects: Are the vertical distances on ...
42 views

### Deriving the Newton-Raphson update for an MLE with two parameters

Suppose we use the Poisson process assumption given by Ni|bi1,bi2 ~ Poisson(λi) where λi = α1bi1 + α2bi2. The parameters of this model are α1 + α2 which represent rate. How do we derive the Newton-...
30 views

### An estimation method/algorithm for estimating the value of a specific parameter in a convex function

I am looking for an estimation/iteration process to estimate the value of a specific unobserved parameter of a convex function that fits the observed data of the other variables closely. Specifically, ...
1 vote
19 views

711 views

### Can arbitrary precision calculations be useful for machine learning?

Regarding machine learning methods but dealing with arbitrary floating-point precision. It sounds cool to me but I am unsure if this would be of any use... Did anyone ever encountered cases where, for ...
111 views

### How many samples are needed to estimate quantiles for an unknown distribution?

I'm trying to evaluate performance of a metric learning model. The model that takes labelled image inputs and maps them to vectors on an N-dimensional unit sphere. The goal of the model is to map ...
61 views

### Do any standard copulas fit well these sampled bivariate data--exhibiting repulsive behavior--having uniform marginals

I'm currently developing a data set that consists of two $50 \times 50$ matrices, which I designate as q1 and Q1. I strongly believe (bordering on formal proof [cf. Corollary 1 in marginalinvariance]) ...
27 views

### Computing score for chess moves based on statistics

There are statistics available for the chess moves that can be played for various opening positions. These stats include the number of games played as well as the number of each of the outcomes (white/...
1 vote
100 views

### Is best model selection by RSS equivalent to best model selection by R2 value?

I am trying to compare models using K-Fold-CV using the regsubsets function in R. By default, it states that the ideal model is determined by the $RSS$. I wished to ...
52 views

### Bootstrapping example ISL - pages 194-195

I'm currently learning about bootstrapping using the book Introduction to Statistical Learning, and am struggling to understand what the point of using the boot ...
58 views

### Is "controlling for variables" via multiple regression the same as feature importance, SHAP values with regression via xgboost?

There are a few posts going over the fact that "controlling for variables" in traditional stats involves building a regression model and including possible covariates in the model. An ...
32 views

### Simulation using the fundamental theorem of simulation (MATLAB)

I have a sub-task of an assignment about the parametric bootstrap method. The subtask is to, given a students t-distribution with $5$ degrees of freedom, sample $10000$ draws using the fundamental ...
1 vote
23 views

### Rademacher Complexity of the family of constant-valued functions

Let $\mathcal{H}$ be a family of constant-valued functions with values in the closed interval $[a, b]$，how to calculate the rademacher complexity of $\mathcal{H}$? We know that the definition of ...
315 views

### Distribution of argmax of beta-distributed random variables

Let $x_i \sim \text{Beta}(\alpha_i, \beta_i)$ for $i \in I$. Let $j = \operatorname*{argmax}_{i \in I} x_i$ (ties broken arbitrarily). What is the distribution of $j$ in terms of $\alpha$ and $\beta$? ...
37 views

80 views

### Probit Regression and Reverse Causality

In the context of my Master's Thesis, I am using cross-sectional data to investigate the impact of digitalisation and it's various tools on the propensity to adopt various sustainable behaviours for ...