0
votes
0answers
5 views

Scikit-learn Normalization mood (L1 vs L2 & Max)

I was wondering if anyone here can explain the difference between the l1, l2 and max normalization mood in sklearn.preprocessing.normalize() module? Having read the documentation I couldn't realize ...
0
votes
0answers
3 views

Maximum entropy distribution of a proportion with known mean and variance? Is it a beta?

Given a proportion and its standard error, what distributional assumption minimizes assumptions/maximizes entropy? Is it the beta (and can I use the method of moments to estimate its parameters)? Or ...
0
votes
0answers
3 views

Paired T-Test or ANOVA or Neither

So I ran an experimental study between an intervention group and a control group who all got assigned a participant number. I tested at 3 time periods, pre, post & follow up. I was going to test ...
0
votes
0answers
7 views

Line flatness metric

I'm building an automated trading system and need to develop a line flatness metric (measure). One way of doing it I though of is taking the first and last points in the dataset, 'drawing' a line ...
0
votes
0answers
10 views

How to normalize data to 0-9 range?

I have two data sets that track the same information using two different scales. The first scales values in the range 0-5 and the second scales values 0-9. I know that the following formula will ...
3
votes
1answer
29 views

40,000 neuroscience papers might be wrong

I saw this article in the Economist about a seemingly-devastating paper casting doubt on "something like 40,000 published [fMRI] studies." The error, they say, is because of "erroneous statistical ...
3
votes
3answers
39 views

How do we know that the probability of rolling 1 and 2 is 1/18?

Since my first probability classes I have been wondering about the following: Calculating probabilities is usually being introduced via the ratio of the "favored events" to the total possible events. ...
0
votes
0answers
8 views

Significant interaction but simple slopes non-significant [on hold]

I have looked at the boards and have yet to find a clear answer to this question. What does it mean when there is a significant interaction but the simple slopes are non-significant besides that they ...
0
votes
0answers
8 views

Should I optimize neural networks that are part of ensemble of neural networks?

I'm creating ensemble of neural networks for a simple binary classification task. Every neural network is generated and trained a bit differently (number of hidden layers, number of neurons per layer, ...
0
votes
0answers
11 views

Prisma App Neural Networks

Can anyone point me towards relevant material that would allow me to understand how Prisma works? http://prisma-ai.com/index.html
0
votes
0answers
5 views

pyJAGS vs RJAGS

I was wondering if there is any empirical studies out there to compare performance of different JAGS bindings, specifically RJAGS and pyJAGS. I am mainly interested in speed. Currently I have an ...
1
vote
1answer
8 views

Simulating an overdispersed negative binomial distribution

I have RNAseq data in the form of normalized counts. The counts themselves follow an over-dispersed negative binomial, and I would like to generate random data which replicate these distributions. For ...
1
vote
1answer
5 views

Mixed model on 1 level (8-catagory) design in R

I have drawing data from 10 subjects drawing 8 shapes (and many repetitions of every shape). I fitted a model to this data Matlab, separately for each subject and each shapes, such that I have 2 model-...
0
votes
0answers
3 views

Scaling breaks for ggplot [on hold]

I have a code: base=plotTsTile(JJ7, plot.title = 'J1', legend.title ='CHLAT', four = TRUE) From the R package wq, their breaks are by decades. I only have 20 years, so 5 year breaks and 10 year ...
0
votes
0answers
8 views

Tune parameters from a specific equation in R

This is the first time I am truing to tune model parameters in R. I have a fairly complicated equation with multiple parameters: ...
0
votes
0answers
11 views

Run regression where dependent variable Y is always constant and independent variable X is not constnat [on hold]

I have a situation where Dependent variable is GDP and that is constant. on the other hand there is one Independent Variable and other dummy variables and they are not constant.I have tried many ...
0
votes
0answers
8 views

Linear Regression and Almost Sure Convergence

Consider a linear regression model, wherein: $$ y_{i}=x_{i}\beta+\epsilon_{i} $$ where notation is standard and $x$ is a scalar. Let us further impose the following restriction: $$ \epsilon_{i}|x_{i}\...
0
votes
0answers
5 views

How to compute (only) the transition matrix of an HMM in a supervised manner?

I am currently working with HMM (Hidden Markov Chain especially) to perform image classification. So far, I have used the Viterbi algorithm to do this as I know the parameters of all class-...
-1
votes
0answers
15 views

Consider a linear regression model with p parameters, fitted by OLS to a set of training data $(xi , yi)$ $1≤i≤N$ [on hold]

Consider a linear regression model with p parameters, fitted by OLS to a set of trainig data ($x_i$, $y_i$), $1≤i≤N$ drawn at random from a population. Let $\hat β$ be the least squares estimate. ...
0
votes
0answers
9 views

Some pointers about training with large datasets

I'm trying to design a neural network (conv. neural networks, the so-called 'deep neural networks'). In this process I'm trying to think of a suitable design for my problem (in a natural language ...
0
votes
1answer
15 views

How do neural networks optimize functions?

This may be a stupid question, but I have been reading into Neural Networks with the aim of using the concepts to optimize a multi objective cost function (aka finding Pareto fronts) which takes a ...
0
votes
1answer
22 views

Regression + Time series

I have time series data about sales/day, but i also want to include other data (static/dynamic) to forecast the time series. Is it possible to combine ARIMA model and regression models to achieve the ...
0
votes
0answers
4 views

Sampling concentration parameter of DP via Slice sampling?

Is there a published work which shows how sampling the Dirichlet Process's concentration parameter can be done via Slice sampling?
0
votes
0answers
7 views

Recompute Neural Network output using weights from Matlab

I'm trying to recompute the output in excel given weights from Matlab's function of Neural Network. I'm working from the "House Pricing" example data set found in the "nftool" function. I selected 1 ...
0
votes
0answers
3 views

Latent dirichlet allocation Variational inference in R

I am trying to do analyse text by using Lda variational inference method. I built document term matrix which is from newspaper. I wonder if anybody know how to code up in R to analyse . if you can ...
0
votes
0answers
11 views

Connections Between Fourier basis and Discrete Fourier Tansform

I need some help to understand discrete Fourier Transform. Suppose we have a toy daily temperate data. The Fourier basis expansion can be $$ \begin{bmatrix} 1&\cos 0 & \sin 0 \\ 1&\...
0
votes
0answers
6 views

Test Support Vector Machine on its own Training Data: issues and observations

I recently concerned myself with SVMs and Sparse Bayesian Machines (RVMs) and was performing feature scaling of my highly skewed data prior to the training of my algorithm. When I was subsequently ...
0
votes
0answers
8 views

KNN on collaborative filtering

After I calculated the similarities matrix, how do I get the neighbors? For example, consider the matrix of similarities between users, if I did not make any mistakes, the matrix must be symmetric ...
0
votes
0answers
4 views

How to estimate “partial” attribute profile choice model?

How does one estimate a choice model (McFadden MNL) on a design where there is a set of fixed attributes and a set of "variable" attributes that cycle in and out of choice sets? I believe this is ...
0
votes
0answers
5 views

Extracting X-13ARIMA forecasts of seasonal effects [migrated]

I am attempting to forecast seasonal effects in various consumer price index components (foods, services, goods, etc.). In other words, I am interested in obtaining - for each time series - forecasts ...
3
votes
0answers
29 views

Family of flexible parametric mappings $f_\theta:(0,1) \rightarrow \mathbb{R}$?

For the purpose of reparameterizing a model (mostly with the goal of improving MCMC efficiency), I am looking for a family of flexible parametric mappings $f_\theta:(0,1) \rightarrow \mathbb{R}$ such ...
0
votes
0answers
8 views

Distribution of Likelihood Values for Simulated Data

Say I have a model with certain parameters and generate a number of simulated data sets from it. If I was to maximise the likelihood function for each data set, how would that distribution of ...
3
votes
1answer
117 views

Probability of finding a new smallest value

I am doing some simulations and I need a good heuristic for when to stop the simulation. The simulation continuously outputs data with a cost in the range [0,1]. ...
0
votes
0answers
5 views

How to evaluate an open-set classification scenario?

We're given an open-set classification scenario, where we have a test set with known classes: $K = \{A_1, A_2, \ldots, A_m\}$ and another (open) test set $U$ with unknown classes than can be almost ...
0
votes
0answers
9 views

Two-way ANOVA unbalanced design: no matching results between R and GraphPad Prism

I'm getting some troubles in comparing results from ANOVA performed with Rstudio and ANOVA from the software GraphPad Prism. They don't match each other despite the same dataset. I have an ...
0
votes
0answers
4 views

Varying outputs for the same train and test data

I have the below sample code in which I am using the sklearn(scikit-learn=0.16.1) 20newsgroup dataset: ...
0
votes
0answers
6 views

Forecasting Incident ticket trend based on past data [on hold]

I'm trying to develop a prediction model the on Incident Ticket logged for my support queue for next 3 months, based on past 12 months data (trend). We need to consider the cause of creation of ...
0
votes
0answers
4 views

Comparing the intervals between population means

First of all, I have to admit that my stats training is somewhat basic, but I'm very willing to look into things, as I really enjoy working with stats. I am working with a household survey which ...
-1
votes
0answers
16 views

Plot data points that has up to 20 dimension using t-SNE tool [on hold]

follow my data set , i would like to plot this data set using t-SNE tool, i have follow exactly the instructions by submit a spreadsheet, but its not draw my points and just view white image , i have ...
0
votes
0answers
4 views

Moderation in Generalized Linear Model

I have conducted an experiment with a control group and two experimental groups (each with a different N). The respondents in the three groups were all exposed to same donation situation. Each of the ...
0
votes
0answers
23 views

How to generate realistic random numbers given mean, max and minimum? [on hold]

My problem is that I am simulating an application scheduling tool but ofcourse I need to validate it with the real thing. In the real tool, all tasks will take some time to execute that is determined ...
0
votes
0answers
8 views

Clustering large graphs - random submatrix SVD. Is it still state of the art?

I am interested in the problem of clustering graphs/datasets with 10s of millions or more feature vectors. I was therefore very interested in this very highly cited paper from 2004 "Clustering ...
1
vote
0answers
11 views

use corrected or uncorrected variance when calculating skewness & kurtosis?

In several online sources, e.g. NIST engineering statistics handbook I have read that for the calculation of skewness & kurtosis I should use N in the denominator instead of (N-1) when calculating ...
0
votes
0answers
14 views

adjusted residual is above 1.96, but the confidence interval goes through 1?

I am analysing whether patients ethnicity affects uptake of the influenza vaccination. I have undertaken chi square test on a 6x2 table (6 categories of ethnicity against accepted/declined vaccination)...
0
votes
0answers
11 views

Publication bias: which test should I use and what are the formula

I am working on the last part of my meta-analysis. I am using a random-effects model. I am looking at uncontrolled effect sizes (difference between pre-test and post-test scores using Cohen's d). I ...
0
votes
1answer
40 views

Running many multiple regressions at once in R

I want to run time series regressions (Fama-French three factor with my new factor). I have following tables. ...
0
votes
1answer
11 views

Average duplicates before fitting?

Common practice for calibration curves is to take several duplicate measurements for each timepoint (or concentration, whatever variable) and fit using the average of each measurement set. The ...
2
votes
2answers
274 views

Discrete probability distribution with two 'tails'

I am interested in knowing whether there is any discrete probability distribution similar to Poisson but also extended in the negative value part (i.e., it can take negative values and there is no a ...
0
votes
0answers
11 views

Number of symptoms and genotype - what is the correct type of regression to use?

I apologise if I do not use the correct terms when describing my problem but hopefully you can help me. I have a data set with around 430 participants. They have given information on the number of ...
0
votes
1answer
22 views

How to get a Variable View in RStudio like in SPSS? [on hold]

One of the things that make it hard to change from SPSS to GNU R is: There is no "Variable View" like in SPSS, no listing of variables you could quickly find a variable name in. This is especially ...

15 30 50 per page