Refers to the interface of statistics and computing; the use of algorithms and software for statistical purposes.

learn more… | top users | synonyms

1
vote
0answers
42 views

Is there an alternative to PCA that produces a unique representation?

PCA produces solutions that are not unique i.e. the resulting representation could be recreated using a different set of points. This is where my problem lies. I was wondering whether anyone is aware ...
0
votes
1answer
13 views

Confidence Intervals And Probability Mean Is Not Closer To Tails

I'm curious if there's a good way to estimate the probability that the true mean of a population falls closer to the observed sample mean than the tail ends of the margin of error. That is, I believe ...
0
votes
0answers
12 views

How to compare data by polynomial

I have heard about polynomial regression. After calculating particular matrices and solving set of linear equations I am getting the polynomial coefficients which approximates the best these set of ...
0
votes
0answers
26 views

Binary Optimization [closed]

One of the world's largest pharmaceutical companies. It was founded in 1849, and aims to discover, develop, and manufacture breakthrough medicines. These medicines are marketed and sold in more than ...
0
votes
0answers
19 views

Developing a statistical index

I have some variables like countable (water consumption in litres per day, medicine intake etc.) and some uncountable variables (mood status, happiness etc.) To develop a happiness index, what kind of ...
2
votes
0answers
26 views

Using the ROC curve in case-control study

I'm conducting a case-control study about vitamin D and the risk of IR (Insulin resistance) among obese individuals (Cases: obese and Controls: normal body weight). I have vitamin D level and IR level ...
0
votes
0answers
15 views

Finding the Significant Differences (with p-values) in a 4x2 Chi-Square Table Using SPSS

In short, I would like to learn how to discover where the significant differences lie within a 4x2 Chi-Square table and report the significant findings with a p-value, preferably using SPSS. Setup: ...
0
votes
0answers
8 views

Measure of consistency and growth

I am analyzing the consistent behavior and growth of different restaurants using different attributes in R. My motive is to provide one coefficient to each restaurant based on its past performance. ...
0
votes
0answers
11 views

What is the best way to analyse data comparing one by one and stipulate the accuracy?

Follow the example: The first line is the data I got. The second line is the target data. | 154.0 | 784.4 | 854.1 | 789.3 | | 153.5 | 789.7 | 892.3 | 903.2 | I ...
0
votes
1answer
35 views

Is Representer theorem valid with constraints on coefficients?

By the representer theorem, we have that in a Reproducing Kernel Hilbert Space the function being learnt in a regularizer + loss function problem under some conditions, can be represented as $\sum_i ...
1
vote
1answer
32 views

What is the standard way to distinguish the errors associated with sampling and measurement in statistics?

This is probably a very basic, yet not easy, question in applied science. I was just wondering, what are usually the standard ways to deal with it? Any pointers to further references are greatly ...
1
vote
0answers
36 views

Sample size when using GPS-trackers to analyze movement of reindeers

If one were to try and analyze the movement of ~2 500 reindeers before and after a (man-made) change in landscape have occured. Specifically how spread out the herd is, both as a whole and if there ...
0
votes
0answers
12 views

Realistic simulation of instrumental data

I want to simulate data collected by an instrument realistically. The problem is that if I use simple Gaussian deviates then an analysis program can guess the truth simply by computing the mean of a ...
0
votes
1answer
41 views

What type of Anova to use and how (in R)?

I tried to find differences between delta G values in amino acids between 9 species. Here is a link to the table that I read in. (The header lists the species): ...
0
votes
0answers
16 views

How to determine correlation between sets of integers

How would I determine a correlation between sets of integers such as the following: set A: 1, 2, 3, 4 set B: 2, 3, 4 set C: 4, 5 set D: 2, 5 I want to have a ...
1
vote
0answers
10 views

Calculate basic statistics for stream of binary data [closed]

I was reading this thread and started to think if there are any statistical tool to analyze binary data. I am mostly interested in the R project since it has good data-analysis tools for decimals ...
0
votes
0answers
5 views

Find the expected frequency of some state in a state sequence of length N given a transition matrix M

I can represent stochastically-articulated sequences of states using a transition matrix M where a given entry in cell (i,j) corresponds to the probability of state j given that the current (or, most ...
0
votes
0answers
32 views

In R, line slope changes when only x values as shifted

I'm new to R, and trying out few examples in it. I'm trying to find the slope of a plotted graph, using lm function. My code: ...
1
vote
1answer
93 views

KPSS test outputs and DF test interpretation

I am running a Kwiatkowski–Phillips–Schmidt–Shin test (KPSS test) in R (urca::ur.kpss). However, I am quite unsure if it is performed correctly, because the ...
1
vote
1answer
45 views

Estimate lag for granger causality test

I am using the granger causality test to check my variables for causality.+ Here is my code: ...
0
votes
1answer
42 views

How to interprete lasso from lars correctly?

I tried the lars package with R and got the following result. ...
1
vote
2answers
69 views

Reference request for beginner in SAS

I am interested to start learning to use SAS, I have used R for some time but for me SAS is a novelty. I do not seek any material in particular, since I'm now beginning to take the first steps with ...
0
votes
2answers
36 views

Test for statistical significance in performance variability

I'm analysing data collected from a call centre activity in which agents are calling prospective leads. For each call made, if the lead coverts the call is a success and if the lead does not convert ...
4
votes
1answer
83 views

Anomaly detection in time series data

Hi I have a large data set of objects, each containing a list of the same attributes. The data is arranged in a time series so that the value for an attribute for an object is indexed by its time. I ...
1
vote
1answer
55 views

Explanation of the different variable types in statistics?

One thing that has always tripped me up when trying to learn new methods in statistics is understanding what type of features/variables can this method be applied to. The variable types that ...
2
votes
0answers
47 views

Difference between “computational statistics” and “statistical computing”?

From Handbook of computational Statistics by Gentle et al, We use the term “statistical computing” to refer to the computational methods that enable statistical methods. Statistical computing ...
2
votes
1answer
86 views

MCEM algorithm in normal distribution

Consider $z_1,\ldots,z_n$ as a sample of observations of $Z$ and $y_1,\ldots,y_n$ the missing data, where $Z\sim N(\mu,\sigma^2+1)$ and $Y\sim N(0,1)$. i)Find the expression of ...
2
votes
0answers
47 views

How would I determine statistical significance for ad impressions?

I'm programatically adding keywords to bid on. Some keywords will trigger ads and impressions, and some impressions will trigger clicks. Clicks / impressions = CTR (click-through-rate). Clicks cost. ...
2
votes
1answer
74 views

What are the general methods for parameter estimation in statistics?

I have a task to estimate the probability of evolution selection of a given node. The only parameter estimation method I can think of is using the law of large numbers, i.e., use the proportion to ...
3
votes
1answer
151 views

An alternative to *The Statistical Sleuth*?

I will be starting graduate school in statistics in August. I purchased The Statistical Sleuth recently [you can view the table of contents by clicking on the "Look Inside" link], and I do think it is ...
0
votes
0answers
23 views

How to train a Gaussian Mixture Model using Testing Data

My work is to extract HOG features from Arabic Line images and than do classification using Gaussian mixture model to have a look at the performance. My question is after extracting the features how ...
3
votes
1answer
57 views

I am having trouble understanding EM gradient algorithm can someone help?

I understand the formula for the EM gradient algorithm but I don't understand what it means by taking one step of Newton's method. Does it mean that it just take one iteration to converge to the ...
1
vote
0answers
48 views

Generation of data from a bivariate distribution

Let $X$ and $Y$ be non negative random variables with joint distribution \begin{equation} F(x,y)=1-e^{-x}-e^{-y}+e^{-x-y-\delta xy}; ~~~x\geq 0,~~y\geq 0. \end{equation} How to generate a bivariate ...
1
vote
0answers
72 views

Median-computation (“grouped median”). Problem with gmedian-computation in SPSS

In my basic-statistics course I wanted to delve deeper into the problem of the (grouped) median-computation and did some computations using SPSS. The protocol seems to indicate either a different ...
0
votes
0answers
47 views

How to design an economic index?

I'm designing a linear economic index: $I_{t}=W_{1} X_{t_{1}}+W_{2}X_{t_{2}}+W_{3}X_{t_{3}}$ where $W_{1}$ to $W_{3}$ are weights of inputs ($X_{t_{1}}$ to $X_{t_{3}}$) and $I_{t}$ is the final ...
3
votes
3answers
94 views

Using KS test to evaluate differences

There are two different empirical CDFs which I have and I would like to evaluate how different they are. The place at which I started was Kolmogorov-Smirnov test - the result in my case looks like ...
1
vote
0answers
61 views

finding the interpolated values of an empirical probability distribution

I have an empirical probability function $p(z)$. In the first column $z$ and the second column contains $p(z)$ values. The data is given as following : data.cat ...
2
votes
1answer
40 views

computational considerations on the regression problems

I am reading Elements of Statistical Learning and read the following claim from the text (page 93, Chapter 3.7): Least squares fitting is usually done via the Cholesky decomposition of the matrix ...
9
votes
5answers
668 views

What algorithm should I use to detect anomalies on time-series?

Background I'm working in Network Operations Center, we monitor computer systems and their performance. One of the key metrics to monitor is a number of visitors\customers currently connected to our ...
2
votes
0answers
31 views

Is there any alternative to the EM algorithm?

I am working on biomedical signal analysis and the most used method for parameters estimation is the EM algorithm. My question is : what are the most powerful alternatives to this algorithm?
0
votes
0answers
19 views

Longitudinal data study and Analysis?

For doing an analysis with longitudinal dataset and to study the relationship between serial of observations of different subjects over unequally time spaced periods and to understand the relationship ...
2
votes
2answers
123 views

Double integral, monte carlo estimation

Suppose I have pairs of random variables where $X_i$~$U[0,1]$ and $Y_i$~$U[0,1]$ and I want to estimate it $$\theta=\int_{0.5}^{1}\int_0^{0.5}e^{xy}xydxdy$$ but $\theta$ needs to have variance less ...
2
votes
2answers
156 views

R random vector generator

Create an R function generating ordered pairs x,y sampled from the two dimensional distribution whose pdf is of the form $f(x,y)=cxy$, where $0<x,y<1$, and $c$ is a constant to be ...
0
votes
2answers
90 views

How to z-normalize multi-dimensional time series?

z-normalization for 1-dim time series is simple. $z_i = (x_i-m)/s$ Here, $x_i$ is the element of series for each time index $i$. $m$ is the mean, and $s$ is the standard deviation. For n-dim time ...
2
votes
0answers
12 views

How to chose the limit of speed for a stop

I have mouse events data(mouse events are generated when the mouse is moving). What would be the best way to calculate when the mouse is stopped? I see two cases: for ...
1
vote
0answers
26 views

How to distinguish histograms having two distinctive peaks?

I have two categories of histograms, one of them has two very distinctive peaks (not necessarily at the same bins/locations every time). What might be a good algorithm/method to find out such ...
-1
votes
2answers
54 views

Interpreting kmeans output

I am working on a clustering model with the kmeans() function in the package stats and I have a question about the output. My data is a sample from several tech companies and AAPL._UP is a variable ...
1
vote
1answer
51 views

How to rank monthly data, using both trends and averages

I have a very large data set containing the daily searches for some Wikipedia entries. I am using the number of searches as proxy of popularity and want to rank the entries. Lets say I have entities ...
1
vote
1answer
60 views

Introductory examples in computational statistics class

I'm looking for an example of Bayesian inference for a class with the properties: The problem is easy to state, and the model & prior are both pretty reasonable, and R can't really calculate the ...
0
votes
2answers
49 views

Compare lists of genes

I have two lists of differentially expressed genes: the list 1 was derived from the universe A of total genes while the list 2 was derived from the universe B of total genes. A number of genes is in ...