A brief numerical description of a set of data.

learn more… | top users | synonyms

0
votes
1answer
23 views

Three Different Regression Results… Why is one so weak compared to the other two?

I have a data set I'm working with, it's roughly 450K rows of data. I'm breaking the data out from a certain column, and that column has three results. After that, I ran a regression analysis for each ...
0
votes
0answers
10 views

Correlation analysis and Clustering in R - Some suggestions [on hold]

I have a biological data, comprising of intensity values associated to 24 masses. Each mass file has 10,000 intensity values corresponding to 10,000 coordinates. So, the data matrix in R would look ...
0
votes
0answers
15 views

Comparing categorical and numerical results simultaneously

This question is in regards to options for analysing a dataset. I have a dataset where we have 23 video clips that have been treated using three different algorithms to change how each clips looks. ...
0
votes
0answers
16 views

Basic statistical significance

I need to check the statistical significance of some survey results. It relates to response surveys for innovation projects. The total number of participants is around 22,000. I'm using results of a ...
0
votes
0answers
15 views

Presenting and analyzing statistics on a telco fraud department? [closed]

Im gonna be assigned to do the statistics of daily postpaid activations at a telco company I work for. They want analysis and not just presenting the stats. Do you guys have any tips on how to ...
1
vote
0answers
20 views

Paired t-test…?

I want to analyze how the purchasing decision to buy a certified food product can be varied due to an information shock. My sample consists of 200 respondents and the responses were taken as dummies ...
0
votes
0answers
18 views

Efficient way to summarise, re-group and plot data set of group frequencies in R [migrated]

I have a set of data for three groups (A, B, C) which gives information on how often a certain value "x" (between -3 and +3) is observed for that group (0 to 100). To give a simplified example: ...
1
vote
1answer
67 views

What descriptive statistics to report for non-normal data

Let's say I run an experiment with one dependent variable and three experimental groups. In the end I would like to report both the results of a statistical test to know if there are any group ...
1
vote
1answer
24 views

Histograms with similar means but different appearances

I have two histograms shown below. As you can see, the two histograms are different in appearance. However, when I calculate the mean of the two histograms, they are pretty similar. The mean for ...
1
vote
1answer
46 views

How do you calculate the standard deviation and error for a difference between two different means?

I have 40 people that I measure at baseline, getting their mean level of X at time zero. I also calculate the standard deviation and standard error of the mean of X. Then after 100 days I measure ...
0
votes
0answers
17 views

what's the right way to combine binomial parameter estimates?

let's say you have a bunch of weighted coins. by observing flips, you can estimate (a confidence interval for) the binomial parameter for each. how should you combine these to summarize the ...
1
vote
3answers
62 views

Cohens d effect sizes

I'm using Cohens d effect sizes as a means of providing a magnitude based inference in a study I'm conducting. I just wanted to clarify if I'm correct here: Anything between .0 and .2 is small. ...
1
vote
0answers
12 views

Recover true statistics for a union of subsamples - only data available are summary statistics for each subsample

Let $a_1$, $a_2$, ...,$a_m$ be the samples of data, and let us further assume the only information we have about each sample is their count/no. of samples, mean, standard deviation and median. The ...
0
votes
0answers
30 views

Portmanteau test vs Breusch Godfrey test

I recently fit a VAR model to two time series and I was trying to check for serial correlation in my model. My main question is, when i use a function called serial.test in the R package, there are ...
0
votes
0answers
14 views

Summarizing output of moving correlation

I have 2 yearly time series (of 55 observations each) and I have calculated moving correlations between them (using windows of length 5 years). My aim is to summarize all the correlations I got into ...
2
votes
4answers
176 views

How to detect abnormality in an otherwise very systematic and regular time-series data for temperature measurement?

I have time-series data, let's say a pandas series, with time (sampling frequency is hourly) as its index and temperature measurement across that time. I want some statistical/time-series principle ...
1
vote
0answers
10 views

Calculate basic statistics for stream of binary data [closed]

I was reading this thread and started to think if there are any statistical tool to analyze binary data. I am mostly interested in the R project since it has good data-analysis tools for decimals ...
1
vote
0answers
12 views

Taming large datasets. How to keep historical data with aggregation techniques?

I will be collecting huge amounts of computer performance data and the datasets will get large very quickly. This necessitates reducing the size of the data by compressing the historical data using ...
0
votes
0answers
11 views

Statistic to summarise multiple timeseries observation with missing data

I have a data frame containing timeseries data on 200 patients ...
0
votes
2answers
70 views

How measuring the proportion of object in several classes?

I have 4 classes and I want to classify objects in each class. I have an arbitrary number of objects indexed from $1$ to $n$. My problem is, when $n$ varies, the proportion can change a lot. For ...
0
votes
0answers
10 views

How to find if any treatment is statistically better or worse in gene data given one standard method and 3 variations

Sorry I am a biologist and it appears am not quite confident enough for statistical analysis. I have datasets that represent different treatments on a biological system. It records how many genes have ...
3
votes
1answer
47 views

How do I calculate a t-score from a p-value (gain scores and N also available)

I have this problem that only the gain scores with the p-value of a t-test are given in a scientific article. The authors neglected to report the t-test statistic and I'm stuck on figuring out how to ...
0
votes
1answer
28 views

Scientific P Value with adjusted R Square [duplicate]

I am running Spearman correlation between 2 variables weight and freight both being numeric. The output I have received from correlation is P value - 0.00E+000 and Rank R Squared is 0.61 and which ...
1
vote
0answers
45 views

How to combine time series measured in multiple experiments?

I have recorded neural activity over time in mice while they perform a task. There are several mice, each ran different numbers of sessions, and repeated the task different numbers of times each ...
0
votes
0answers
24 views

Regression Analysis and Conditional Expectation

I have to calculate a Expectation of some expression conditioned on something. I know alpha, Beta1 and Beta2 in the below expression. Income and Family_Size are 2 Uniform Random Variables between 0 ...
2
votes
1answer
72 views

Is it possible to compute a correlation between two variables from just means, standard deviations and sample sizes?

Is it possible to compute the correlation between two variables with just the mean, standard deviation, and sample size? If so, how would I go about it?
0
votes
0answers
41 views

Market Basket Analysis

I am learning "Market Basket Analysis" and I need a clarification about Advantages and Disadvantages or Pro's and Con's of the "Market Basket Analysis". And some cases where actually this "Market ...
0
votes
0answers
26 views

Measure for comparing serial measurements of multiple variables in treatment vs control group?

Can anyone suggest whether I am going about the statistics in an appropriate way? I have two groups of populations which have similar characteristics. In each member of both groups, serial ...
0
votes
0answers
21 views

minimum sample size to estimate chi square population mean

Let's say I have a chi square population, I required to evaluate the minimum sample size to estimate the mean with confidence level 1-alpha, I remember that Confidence level calculation based on ...
0
votes
0answers
54 views

Combining multiple metrics to provide comparisons/ranking of k objects [Question and Reference Request]

Collecting $n$ metrics about $k$ objects Suppose I collect $n$ metrics about $k$ objects. I am looking into valid ways to compare the $k$ objects so they can be "ranked". I think this may be ...
1
vote
1answer
12 views

Allocating consumption to products

Following scenario: Data from 12 truck companies is available. For each company the absolute value of diesel consumption is available. Each truck company can ship Product A, Product B and Product C – ...
2
votes
1answer
20 views

How to display potential outage when usage fluctuates greatly among customers?

I work for a Health Information Exchange. We have numerous "participants". Some send hundreds of messages a day, some might go a day or two without sending any messages. I'm creating a daily report ...
4
votes
1answer
97 views

Log Transformation

I am planning to run a 2x2x3 repeated measures ANOVA on reaction time data pre and post treatment. However, my data is skewed and I wanted to do a log transformation but have few questions. Can I ...
0
votes
1answer
26 views

Meaning of a higher out-of-sample $R^2$ but also a higher MSPE

I am comparing several forecasting methods using the out-of-sample $R^2$ and MSPE. Now I have encountered situations in which the $R^2$ of a certain method is higher than that of the other, but the ...
3
votes
1answer
93 views

What's the meaning of dimensionality and what is it for this data?

I'm doing my assignment for my "Modeling and Optimization" course, and now I have doubts on the first question: What is the dimensionality of the data? What are the min, median, max, mean, ...
0
votes
0answers
10 views

quantiles over moving window

A subrutine of a computer library calculates the quantiles over fixed spaces for all of my dataset : eg it calculates: ...
0
votes
1answer
43 views

Analysing data from summary table on R (interactions)

If I want to test whether data[,1]:setB is equal to 0 or not, do I just use the given t value and p value or do I need to add it with the data[,1] values? looking at the p value of data[,1]:setB, I ...
1
vote
1answer
34 views

Rewriting RegressionSS

I am having troubles in deriving the RHS of this formula: $$RSS= \hat{\beta}^{T}Z^{T}y-n\bar{y}^{2}$$ where $Z$ is the design matrix I am given ${y}^{T}y$ (what exactly does ${y}^{T}y$ stand for and ...
1
vote
1answer
51 views

How to rank monthly data, using both trends and averages

I have a very large data set containing the daily searches for some Wikipedia entries. I am using the number of searches as proxy of popularity and want to rank the entries. Lets say I have entities ...
1
vote
0answers
38 views

Quantifying how uniformly spread out points are?

I'm looking for a way to quantify how "clumped" vs homogeneously/uniformly distributed points are in a graph. Each collection has 100 points as (x,y) pairs. I've attached two graphs as an example. ...
0
votes
1answer
116 views

De-normalizing Google Trends data?

Does anybody have suggestions on how to de-normalize Google Trends data? The site says that their trends are made with the following metric: The numbers on the graph reflect how many searches ...
0
votes
0answers
16 views

Statistical Comparison of two different waves

I have two waves data for a couple of cities and I need a comparison W I W II City A 10,000 10,100 City B 200 202 City C 1500 1515 There is a 10% increase of ...
0
votes
0answers
45 views

Averaging standard deviations of unequal weight?

I'm sorry if the title is unclear, but I'm not sure of the appropriate way to phrase this question. I'm in med school (and sadly not as versed in statistics as I ought to be), and I am trying to use ...
0
votes
0answers
36 views

Descriptive and Inferential Statistics

I am doing a time series analysis (stock market returns) and I am currently looking at the summary stats. I know the definitions of the individual stats but the one I am stuck on is the relationship ...
3
votes
1answer
420 views

Using a rolling window in time series regression

I am learning about regression. I have done some cross sectional regressions which are fine. I recently did a simple time series regression. So I have a y & x vectors each containing 1000 ...
0
votes
0answers
60 views

Is there a name for this sort of plot? Is there any reason not to use it?

Suppose we have some time series data, with multiple samples per time unit. For example: ...
1
vote
1answer
110 views

How to compute the pdf analytically for the sum of generalized gamma

Question: problem statement $$z^d = \sum_i x_i^d $$ pdf of $X = \frac{d(\lambda x^d)^n}{x \Gamma(n)} \exp(-\lambda x^d)$ which is a generalized Gamma distribution and they represent euclidean ...
0
votes
3answers
71 views

interpret scatter plot if there is anything to interpret from it

I have an x variable and a y variables. I have done a simple scatter plot. I however don't really know how to interpret (if there is anything to interpret) the plot. I can't find any other similar ...
1
vote
0answers
64 views

MECE statistics

Consider a sample of a real quantity $X$. Say that we divide this sample into two mutually exclusive and collectively exhaustive (MECE) groups. Say we know the mean and median of these two groups, ...
0
votes
1answer
63 views

A Simple Regression Model for Our Experiment? [closed]

We know, In statistics, simple linear regression is the least squares estimator of a linear regression model with a single explanatory variable. In other words, simple linear regression fits a ...