0
votes
0answers
12 views

Statistical measure of international diversity

I've got a large collection of geotagged tweets, each linking to an article from a given author. For each author, I'd like to derive a number that describes how diverse is their list of tweeting ...
1
vote
0answers
8 views

Data Science: self study

I need your suggestion to solve this problem: Given a Data Warehouse with e.g. 10 million entries, additional 1000 entries arrive each day. Rather than recomputing the desired aggregates, an ...
1
vote
0answers
6 views

Multiple Reg with 2 Independent Variables that are Correlated - Orthogonalizing the IV's

I have two Ind. V's, $x_1$ and $x_2$. They are slightly correlated with eachother. $x_1$ explains a significant portion of $y$'s variability. Rather than just modeling $y = \beta_0 +\beta_1 x_1 ...
0
votes
0answers
8 views

Scoring function for categorical data

I would appreciate guidance on the following problem. There are three sets of urns, Set 1, 2, and 3. Each set contains the same number of urns, Urn 1, 2, 3. Each urn contains some number of Red ...
0
votes
0answers
6 views

Hierarchical weighted linear regression through the origin and varying slopes within groups

I am trying to fit a hierarchical linear regression model. My data includes samples with 10 different classes, and samples have varying numbers of data points (from 1 to ~1000). I want to fit a ...
0
votes
0answers
10 views

How to calculate classification accuracy?

I have Train and Test data, how to calculate classification accuracy with evaluation top-label ? ...
0
votes
0answers
20 views

Naives Bayes example walk through

My instructor have give me an example that I didn't really understand, can someone help me in understanding it? Given a list of occupation and a list of grocery bought I want to recommend a list of ...
3
votes
2answers
36 views

What is a log-odds distribution?

I am reading a textbook on machine learning (Data Mining by Witten, et al., 2011) and came across this passage: ... Moreover, different distributions can be used. Although the normal ...
0
votes
0answers
3 views

Precision in a multi-label classification when empty set is predicted

As we know, for a test instance, the precision of a prediction is defined as |T intersect P|/|P|, where T is the true set of labels and P the predicted one. Then what is the precision when P is ...
0
votes
0answers
4 views

Calculating PLV (phase locked value) using ifreq function in seewave package in R

I am trying to calculate the PLV (phase locking value) using the seewave package in R. My code for calculating the PLV looks like this: ...
0
votes
0answers
18 views

Importance of independent variables; continious vs categorical

I have many independent variables which are affecting the outcome of a dependent variable (dependent variable is "return_impression" in figure below). When I measure the importance of these ...
0
votes
0answers
19 views

Interpretation of priors in example

Suppose I have 3 variances $W_{j}$ that can be expressed as $W_{j}=q_{j}V$ with $j = 1,2,3$. According to one model, I want $W_{3}$ to be "pronounced" and $W_{1}$, $W_{2}$ should be small to avoid ...
0
votes
0answers
5 views

How to find the joint distribution in embedded space

Euclidean Embedding of Co-occurr ence Data under Section 2, the problem formulation is given. In the paper link, the Authors find the distribution for lower embedding for the squared distances between ...
1
vote
1answer
16 views

Linear model decomposition

Is is possible to decompose fitted linear model? What I mean by that: I have parameters of fitted linear model as following: y=2.3a-1.23b+1.65c+1.76d Now I have ...
3
votes
0answers
7 views

Fisher test of periodicity

I have evenly sampled time series on which I applied Fourier transform. I am trying do determine if the signal contains statistically significant periodic components. I have succeeded with determining ...
0
votes
0answers
7 views

Predict magnitude from angle in linear regression

I have some data where I want to see if the magnitude of an effect depends on the direction. (Analogous to asking if wind speed depends on wind direction, for example.) In the circular package there ...
0
votes
0answers
8 views

Model averaging with MuMIn. What's the mean of pvalue?

the summary() of a model.avg made with MuMIn in R, give a lot of interesting results, in particular model averaged coefficients (estimate, standard error, adjusted standard error and a z value with a ...
0
votes
0answers
16 views

How can I grab specific data points from one spreadsheet based on another spreadsheet? [on hold]

I am a journalist currently trying to crunch some data for a story I'm writing about Maine's craft beer industry. I have been given two spreadsheets related to beer production from the state, and ...
0
votes
0answers
19 views

variance of the variance for finite population for normal distribution

I am interested in calculating the variance of the sample variance for a finite population...of course in the limit of sampling the entire population, this will be zero. There seems to be one author ...
1
vote
0answers
17 views

Which statistical test to use with repeated measures & clustered observations?

I am doing experimental study for my research. I have class with 24 students and six groups, where each group includes 4 students. I want to compare the performance of each group in two cases: first, ...
1
vote
0answers
6 views

When comparing variability between unequal samples, is there a way to correct for sample size?

I am trying to compare test measurements taken at three time points in a training paradigm. The data for each test consists of a number of durations in ms. The variable I'm interested in is the ...
0
votes
0answers
8 views

PSM, Diff-in-Diff and Neg-logged income variable? How to interpret estimates?

I am estimating a difference-in-difference based on propensity score matching. The "treatment"-variable defines whether a household registered for a public insurance which was only active for two ...
0
votes
0answers
3 views

Requirements of text-sources for most promising results with Latent Dirichlet Allocation (LDA)

I was wondering if there are any papers about the efficiency of the LDA in terms of human reception in relation to the document-type. Resprectively, are the topics that LDA finds for books, ...
2
votes
1answer
22 views

Statistical test for repeated measures ANOVA with covariates

We have 10 participants who have undergone a cold pressor test (for pain) in 3 conditions (no drug, drug A, drug B). It is a repeated measure design. The stimulus is continued for 1 minute after they ...
2
votes
0answers
41 views

How do I handle nonexistent or missing data?

I tried a forecasting method and want to check if my method is correct or not. My study is comparing different kinds of mutual funds. I want to use the GCC index as a benchmark for one of them but ...
0
votes
0answers
13 views

how could i handle with missing data or non existent data? [duplicate]

i tried a forecasting method and i want to check if it is correct or not and why? my study is about evaluating mutual funds for two kind of them it is a comparative study and i wan to use gcc index ...
1
vote
0answers
22 views

Regression model for predicting life expectancy

I have average life expectancy at birth data for an 8 year period and I would like to use that 8 year period to predict the trend for average life expectancy for the next 5 years. I would then like to ...
1
vote
1answer
35 views

Time series with correlated observations: How to start analysis?

We have a time series dataset: Daily arrivals of asylum seekers. Goal is to model this variable. In particular we would like to attempt Arima modeling and/or fitting a distribution. Before we get to ...
0
votes
0answers
8 views

The GPD part of transforming standardized residuals to uniform variates

I need help (or clarity) with transforming a series of standardized residuals, through their parametric CDF, into uniform variates. I started with the awesome R-package, "rugarch": spec <- ...
0
votes
0answers
10 views

sequential importance sampling step by step

I'm experiencing some problems when learning particle filtering (without resampling). I've found examples where the bootstrap filter has been used but none using the sequential importance sampling. ...
0
votes
0answers
6 views

Using t-test for feature selection after z-scoring data?

Suppose I have a high-dimensional dataset, and a binary classification problem. I want to use the two-sample t-test for feature selection. If the data has been normalized by z-scoring (so it has zero ...
1
vote
1answer
11 views

Best statistical method to show different performance week over week

I am trying to get best statical method to show performance of accumulative revenue by customer compare week over week. Currently I have about over 100 customer charts compare by hour from same day ...
2
votes
2answers
32 views

The Mean of the number of times until an event occurs

Lets say we have 6 cards in a hat, that are all red. Now each time, we blindly take a card out of the hat: - If the card is red, we take it out of the hat and insert a blue card. - If the card is ...
0
votes
0answers
11 views

Plot eigenvectors Matlab [on hold]

I had an A table and found the eigenvectors which are ...
0
votes
0answers
19 views

Two Gaussian Likelihoods with Two Decision Boundaries , 0/1 loss function

we assume that Y := {1, 2}. Then our decision can be re-written as y ∗ = {1 if p(x|y = 1) > p(x|y = 2) , 2 otherwise} with a decision boundary at p(x|y = 1) = p(x|y = 2). How can we construct an ...
0
votes
0answers
18 views

Is the assumption of linearity necessary for the convergence of the least squares method to the MSE solution

More formally, say there are input vectors $\bf x$ and scalar outputs $Y$ being generated i.i.d. from a joint distribution $p$ and we are interested in estimating $\mu({\bf x}) = {\mathbb ...
0
votes
0answers
21 views

Shape uncertainty of a 3D point cloud

Given a point cloud of a 3D object, how to calculate the shape uncertainty in this discrete sample set? and what factors maximize or minimize this uncertainty?
0
votes
0answers
17 views

Grouping similar plots together in a Stripchart [migrated]

I have groups of data that I want to put more closely together on my strip charts ...
0
votes
0answers
10 views

When compare a variable in different times, one has normal distribution, another doesn't, which test should I use?

The question is to compare means of sales volume in different periods. So I got sales period 1 and sales period 2. Sample size is 40. The skewness, kurtosis, test of normality and histogram all show ...
0
votes
0answers
4 views

revert minmax normalization back to original value

i'm training a neural network. Normalization of inputs and outputs (training data) are carried out using min Max to a scale of [0-1]. I'm applying backpropagation learning algorithm. Firstly, i need ...
0
votes
1answer
26 views

Cannot perform tests for multivariate normality. Is my data set too large?

I'm examining the performance of quadratic and linear discriminant models at classification. My dataset has 250,000 observations, 2 groups and 30 explanatory variables. I thought it would be worth ...
0
votes
0answers
9 views

Incremental Aggregation: need some clarification

I have started some self study on Data mining algorithm. Recently I came accross a problem. I need your hint: Given a Data Warehouse with e.g. 10 million entries, additional 1000 entries arrive each ...
0
votes
0answers
12 views

Statistical Significance of Turnaround Time

My laboratory recently implemented MALDI-TOF MS for identification of gram negative rods in blood cultures. I collected data retrospectively from laboratory reports comparing the time from isolation ...
0
votes
0answers
10 views

What is divergence in indicators/oscillators?

What is the direct cause of divergence in indicators/oscillators? Is it because of using the close price? How could I filter it out or isolate it? This would be useful to extract for a predictive ...
0
votes
0answers
3 views

Reporting sensitivity/specificity using a random process?

I'm using a method that involves cross-validation to make predictions on my dataset. As it splits the data randomly, I will end up with different results (I believe this is an example of a stochastic ...
3
votes
0answers
18 views

Distribution of a binary matrix times a Bernoulli vector

Suppose we have the vector $\mathbf{Y} = (Y_{1},\ldots,Y_{n})$ where $Y_{i} \sim \textrm{Bernoulli}(p_{i})$ independently. For the applications I have in mind, $n$ will typically be several thousand, ...
0
votes
0answers
6 views

Is there a SAS equivalent for JMP's life distribution?

I have a work flow where I use SAS to pull and prepare my data into censored data, and then open the SAS dataset in JMP and perform a life distribution analysis on the data. More often than not I use ...
0
votes
1answer
61 views

What statistical analysis did they do in this paper?

This is really a beginner question. I have to perform a statistical analysis which is exactly the same as the one conducted in the table shown in the picture. Specifically, how to calcolate the ...
0
votes
0answers
11 views

interpreting y axis of a partial dependence plots

I have read through other topics on partial dependence plots and most of them are on how you actually plot them with different packages, not how you can accurately interpret them, So: I have been ...
0
votes
0answers
5 views

Aggregating Results for pvclust [migrated]

What is the best way to summarize the means or medians of the clusters identified by pvclust? I have done it before with hclust using the cutree command to identify clusters. I have then aggregated ...

15 30 50 per page