Questions tagged [z-score]
The z-score of an observation is the number of standard deviations above or below the mean of the distribution of observations from which it came.
234
questions
0
votes
1answer
15 views
how to treat binary variables when normalizing for DL model?
So I am doing preprocessing for deep learning model. I have mix of binary and continuous variables. I will normalize continuous variables to z-scores (to standard normal distribution). Should I "...
0
votes
0answers
10 views
Scaling before autoencoder for anomaly detection
So I want to use autoencoder for binary classification (0 is normal, 1 is anomalous sample). I have training data which are artificially balanced and consists of both 0-s and 1-s, and testing data ...
0
votes
1answer
31 views
Outlier detection using the difference between two z-scores
Long story short: Can you use the difference in z-score of two variables as an outlier detector.
I have this data set which had poor quality data. Lots of measurement/human error and probably also ...
1
vote
1answer
17 views
Can the output of a probit regression with a Z-score predictor be interpreted as a standardised effect size?
I want to obtain a standardised effect size for a regression with a binary outcome. If I standardise the (continuous) predictor and run a probit regression, the resulting coefficient can be ...
1
vote
1answer
38 views
Why is the denominator of z-score for linear regression coefficients called standard error?
In machine learning and linear regression applications, the z-value is given by the following formula:
$$z_j = \frac{\beta_j}{\hat{\sigma}\sqrt{v_j}}$$
where
$$\hat{\sigma}^2 = \frac{1}{N-p-1}\sum_{...
1
vote
0answers
15 views
Why do we use z-score proportions when we can easily calculate the exact proportion?
What's the purpose of z-score proportions when I can easily find the exactly proportion by counting how many measurements there are in range(x,y) and divide by sample size?
0
votes
0answers
6 views
Assessing variability in a repeated measures study
I want to assess technical variability/dispersion between several same-subject measurements (i.e which groups have more variability):
My data consists of a set of cases (with age and sex variables) ...
0
votes
1answer
31 views
Correct z-score implementation for a hypothesis test in Python?
I have been getting some bizarre z-score calculations and wanted to confirm whether my concept and/or implementation is correct.
I have a pandas DataFrame ...
0
votes
1answer
24 views
Hypothesis testing critical value [closed]
-4.67 < a negative z $\iff$ 4.67 > a positive z
I don't understand this equation, please help me.
0
votes
1answer
18 views
PCC as covariance of z-score scaled variables and weights incorporation
I've usually seen the Pearson Correlation Coefficient as :
$$
\text{PCC}(u,v) =
\frac{
\sum_{i \in I_u \cap I_v}{
(r_{ui} - \mu_u)(r_{vi} - \mu_v)
}
}
{
\sqrt{
\sum_{i \...
0
votes
0answers
25 views
Z-score from Skewed Student T
I'm implementing the following method. The text is provided for background, but my question is about line (8).
Am I understanding this as "a z-score generated from a standardized skewed Student t?"
...
0
votes
0answers
17 views
z-score using arithmetical mean or annual compounded return
I want to predict the probability of a specific stock market index return based on a set of 90 yearly returns.
For doing that, I thought about normalizing the data and then use the z-score to ...
0
votes
1answer
45 views
How to determine 95% confidence interval for known population variance?
Consider group 1 only and suppose that the population variance is 12. What is the 95% confidence interval for population 1?
Group 1 (Experimental Group)
X bar 1 = 33
Sample size = 10
Population ...
0
votes
1answer
60 views
Way to make Z-Scores Positive
Hoping for some help with this. I need to calculate the the ranking for a number (eighty or so) groups, based on a number of component scores. Each component score is weighed. For example:
Component ...
1
vote
1answer
50 views
comparing z scores from variables with different value range
I'm trying to understand z scores and how to use them.
As far as I understand, I can use the z transformation to be able to compare different variables with different value range, that were not ...
0
votes
1answer
40 views
QQ plot comparison of z-normalized datasets
I want to make sure I'm correct in my assumptions.
I'm predicting financial returns by using different ML models. There are 4500 values in each dataset.
The density plots of all models are shown like ...
-2
votes
1answer
51 views
How to convert data (percentages) into z-scores?
I have data for total population and percentage of smoking for 10 cities. The data look like below:
How do I convert the percentage_smoke into z-score? Do I need to take into consideration of the ...
2
votes
1answer
40 views
Significance of differences between group-differences
Background: We have RNA-seq data (a method to quantify the expression of genes in a cell) from different cell types. These data were normalized using a method called TMM and then log2-transformed ...
2
votes
1answer
211 views
Calculating P-Value of a Z-Score without using Z-Table [duplicate]
I couldn't find any videos or documentation that shows how to calculate p-value of a z-score without using z-table. Isn't it possible or is it that hard?
I know i can use scipy to get that ...
0
votes
1answer
14 views
Validate Z-score Formula
I need need help validating a formula for a z-score. I have a book that I enjoy but in my re-read of the materials, I have found that the author has made some fundamental errors in their writing. So, ...
0
votes
1answer
58 views
From what type of distribution does observed z score come from, and based on this picture, what is the variance and mean?
I am trying to understand this conceptually and mathematically but somehow these formulas and variable expressions are confusing. If someone can explain it in simpler terms, it would be appreciated. I ...
1
vote
0answers
30 views
Confidence interval for the mean
If we want to create a confidence interval to estimate the mean of a specific population and we want the margin of error not to exceed $10$ at confidence level of $90\%$ given that some study suggests ...
0
votes
2answers
35 views
Transformed continuous variable Z-Score to Percentile
I had a non-normal distribution of my variable of interest which required log10-transformation to reduce outliers. This was then standardized, to a mean of 0 and sd of 1 (z-score?). I now want to ...
-1
votes
1answer
117 views
How to normalize values but keep them all positive [closed]
I have an array of speed values that I would like to normalize. However, I need no value to be negative as I am doing a transformation of this data later on using division with revolutions per minute. ...
0
votes
0answers
8 views
How to compare outcomes of fantasy baseball statistics
My fantasy baseball league is head to head, weekly, with 12 categories. For each category you win (i.e., get more stats than your opponent) each week, you get one point, for a total of 12 possible ...
1
vote
1answer
28 views
Comparing survey data to passively measured data
Basic Situation:
I have quite a large sample of around 10k people.
In that sample I have two values for each person: a passively measured value of an amount of time, as well as their estimation of ...
0
votes
1answer
20 views
Paired t Test on Z normalized values
I have 2 sets of data, each consist of 92 data points. Pearson's correlation between them is 0.22. My hypothesis is the data sets are not significantly different, so I've normalized each datasets with ...
1
vote
0answers
13 views
Does Mahalanabis Distance have something to do with Min-Max normalisation? [duplicate]
Does Mahalanabis Distance have something to do with Min-Max normalisation?
I know that it has something to do with Z-score normalisation, but when I tried Mahalanabis Distance on the Min-max ...
0
votes
1answer
40 views
Getting critical values - clarify solution [duplicate]
Two brands of coffee were compared. Two independent random samples of 50 people each were asked to taste either Brand A or Brand B coffee, and indicate whether they liked it or not. Eighty four ...
1
vote
1answer
49 views
p-value approach - clarify teacher's solution?
So I have a question with my teacher's solution below and I'm confused about one of the steps in their solution. I would appreciate some clarification.
Two brands of coffee were compared. Two ...
0
votes
0answers
10 views
Calculate quantile using z-score in a normal distribution [duplicate]
I've got some z-score values and need to get the percentile (normal distribution)
Of course I can use tables like: https://www.pindling.org/Math/Learning/Statistics/z_scores_table.htm
But shouldn't ...
2
votes
1answer
43 views
Standard deviation Vs ٍٍStandard error
I'm little bit confused, when I want to standardize a normal distribution, when to use standard error and when to use standard deviation ?. In statistics we often use samples so, is it always we use ...
1
vote
1answer
76 views
Combining z-scores in clinical practice
I am a clinical neuropsychologist working with children with neurodevelopmental disorders. I have a quite naive question but we are unable to solve it with my colleagues (we are not very good in ...
0
votes
0answers
9 views
Equation for converting z-scores to percentiles [duplicate]
I need the mathematical formula for transforming z-scores into percentiles. I can't find it here or anywhere on the Web.
1
vote
1answer
36 views
Statistics probability help - can someone confirm my solution? [duplicate]
In a certain population, 15% of the people have Rh-negative blood. A blood bank serving this population receives 100 blood donors on a particular day.
(a) What is the probability that 15 to 20 (...
1
vote
2answers
59 views
Estimating population mean $\mu$ based on a sampling distribution
I've learned that under certain codnitions I can assume the mean of the distribution of sample means to be approx. equal to the real mean of the underlying population. Additionaly, the standard ...
0
votes
1answer
45 views
Find probability using Z-scores - don't understand solution
Graduate students applying for entrance to many universities must take a Miller Analogies Test. It is known that the test scores have a mean of 75 and a variance of 16. In 1990, 50 students applied ...
1
vote
0answers
9 views
Helpr finding the z-scores for several rows of numbers that represent different variables? [closed]
For example, if I had a table that looked like
A. 1 2 3 4
B. 4 3 2 1
C. 2 2 1 3
D. 4 1 1 1
To find the Z score for Row/Variable A, would I use a mean of 2.5 (mean of row A) or a mean of 2.18 (...
1
vote
1answer
78 views
How to normalize if variance is zero?
How do I normalize a dataset to z-scores is some features have variance zero? Is throwing them away beforehand the only solution?
3
votes
0answers
35 views
Why was the letter z chosen in z-scores?
Why was the letter z chosen in the name of a z-score = (data value minus mean) / standard deviation and not any other letter?
This might be related to the same letter z being frequently used for the ...
0
votes
1answer
32 views
Use z-scores as measure for regression analysis/ANOVA
I want to calculate the difference between a certain value associated with a decision alternative and the value associated with the objectively correct alternative as a measure of decision accuracy in ...
0
votes
0answers
30 views
Comparing z-scores, one variable pre-/post test
I am working on an assignment where I am going to compare a group of students test scores measured in a pre-test with the same group of students test scores measured in a post test. Due to the way ...
0
votes
0answers
49 views
Comparing two z-score variables
Say I have 2 variables (height and weight) for 20 people. Each height and weight value will be converted into a z-score (calculated using age and gender dependent population norms).
Weight and ...
1
vote
3answers
58 views
Z-scores for different size groups
I want to know how I can calculate the Z-scores for groups with different sizes?
Let me try to explain:
We have a city with 100.000 inhabitans.
The city is divided in 10 neighborhoods, all with ...
0
votes
0answers
23 views
Comparing regression/correlation values within-subjects? Repeated Measures ANOVA afters Fishers Transform?
I was interested in the most appropriate way to assess whether there is a difference in the R values from a regression analysis in a repeated measures design.
I transformed my R values using a ...
0
votes
0answers
26 views
Scoring the difference between a family of distributions and a test distribution
Let's suppose we have a random model that I can sample to generate distributions of a certain 1D variable. I want to score the distance of a test distribution to the model in question. The distance ...
2
votes
0answers
30 views
Probability of getting two $z$-scores that are within one standard deviation of each other
Randomly choose two $z$-scores following a normal distribution with mean 0 and standard deviation 1.* What is the probability that the $z$-scores are within one standard deviation of each other?
-1
votes
1answer
24 views
clustering analysis\ data is in right skewed
what normalization technique(mean normalization/min max/zscore) is prefered to apply k-means clustering scope of data: right skewed variables are different scales & magnitude(days,counts) ...
0
votes
0answers
40 views
Confused about z-score image normalization output
I am trying to normalize my input data for a convolutional network, I applied the z-score normalization technique to my image dataset as follows:
Formula: (image - mean(image)) / std(image)
...
0
votes
0answers
78 views
ANOVA or T-TESTS on Z-SCORED data
Let's assume that we have results from X people for 3 different variables. The scores are not on the same scale (for example they're not scores on the test when you can simply reach from 0-10 points). ...
