# All Questions

5 views

### Is there a limit proportion of 0 and 1 to fit binary data using glm (link “logit”)

In relation with my other question here where I observe a strange behavior of the residuals after fitting binary data using glm/glmer, I now wonder: Are there boundaries on the proportion of 0 (or 1) ...
4 views

### Statistically significant increase in Matthew's Correlation Coefficient

Suppose I have two classification algorithms A1 and A2, and a test set of size $n$. I evaluate A1 and A2 on this test set, and get corresponding Matthew's Correlation Coefficient scores ...
5 views

### k means clustering for larger text fields

I'm a beginner in data science/machine learning and am attempting to work through some problems on my own I am running a K-means clustering on a dataset consisting of "mission statements". These can ...
8 views

### Residuals with glm / glmer don't have null mean

I am trying to fit accuracy data (taking values 0 or 1) using glmer and I am puzzled to observe that the residuals of the model don't have a null mean. Wasn't this the whole point of the ...
5 views

### Fitting AR model, multiple spikes in PACF plot

I'm trying to fit an AR model with the following ACF/PACF plots: I'm wondering what AR parameter would be most suitable for data that has this correlation structure. Specifically, how to deal ...
6 views

### Boltzmann Machine (or RBM) : importance , researchers

I have been very interested into Restricted Boltzmann Machine lately, and did quite some research & related mini-projects. I am quite curious about: 1, How important it can play its role to the ...
6 views

### Roadmap to forecasting needed! [on hold]

I'm working in R and have been trying to forecast GDP by using the spread between Treasuries and corporate bonds. I've ran into some trouble though as I don't have a clear understanding of the steps ...
11 views

### Preprocessing in predictive models

I'm trying to make a predictive model using logistic regression but before that I'm wondering what kind of explore I can do on my data to get a better understanding or even help me with the model ...
12 views

### Alternative to self-organizing maps for image clustering

I'm thinking to use self-organizing maps (with TensorFlow) to group images of people by some characteristics (like the color of their clothes). Any experiences with SOM on such task or do you suggest ...
6 views

### MCMC diagnostics for EMC or SMC

Are diagnostics developed for MCMC (e.g. Gelman-Rubin, Geweke) suitable for output from Evolutionary Monte Carlo (EMC) or Sequential Monte Carlo (SMC)?
8 views

### Interpreting log-loss as percentage

I know that log-loss penalises models that are confident with the wrong predicted classes. Can this be translated to percentage accuracy? If not, then how do I report the error or compare it to other ...
8 views

### Whole life cost question [on hold]

Hi I have a problem with this question "Consider the following costs for a new bridge with a projected service life of 120 years: Construction cost: 10 units Programmed maintenance: 1 cost unit ...
19 views

### Correlation between several variables in different study areas

I want to test the correlation between variables considering several study areas. I aim to study habitat selection using telemetry data (locations) in five study areas, and I have variables regarding ...
15 views

### Scikit-learn's SGDClassifier code question

I have a question regarding the code of function SGDClassifier, from library scikit-learn, which implements linear ...
4 views

### VAR lag length vs Johansen cointegration test outcome?

First puzzle: I am taught that the lag order of VECM does not affect the cointegration rank because the lag order is for the differenced regressors. But, I see the contrary: I experimented with sample ...
3 views

### Is there a need to scale data before a Factor Analysis on Mixed Data using FAMD() in FactoMineR package R?

I want to do a Factor Analysis of Mixed Data using the FAMD() function in the FactoMineR package in R in order to explore a data set. The aim is to reduce the dimensions of the data set for predictive ...
135 views

### I did PCA of my dataset with two classes and here is the scatterplot; how can I tell if my dataset is learnable?

What should I look for in my PCA? I'm doing supervised learning with (unfortunately only) 2000 examples, evenly split into 1000 yes and 1000 no. Each vector is a 1000 dimensional boolean vector. I ...
12 views

### Hidden Markov Model and State Space models

I am pretty sure that Hidden Markov models are a particular instance of state-space model but I cannot understand in what they are "particular". I mean, state-space models are based on two ...
16 views

### Different results for Bayesian ANOVA in JASP and R (BayesFactor)

I computed Bayes Factors for a repeated measures ANOVA in JASP and the R package BayesFactor. There were two between-subjects groups (factor "group") with multiple measurements. However, the results ...
4 views

### Prewhitening Regressors in Lagged Time Series Regression

I'm trying to identify significant lags in a time series regression such that $Y = \beta_0X_t + \beta_1X_{t-1} + ... + \beta_iX_{t-i} + \alpha_0Z_t + \alpha_1Z_{t-1} + ... + \alpha_jZ_{t-j}$ I ...
8 views

### Multivariate Analyses of Matched Case-Control Data

I'm a medical student and working on some public health research. I'm new to the forum and I am completely stumped right now trying to figure out how to handle the issue of multivariate analysis of ...
17 views

### CCA: compute estimated (x,y)-coefficients from the output of sklearn.cross_decomposition.CCA [on hold]

Consider this token CCA (canonical correlations) example in R: ...
21 views

### Can we use MLE estimates as hyperparameters of bayesian linear regression?

Given a linear regression \begin{align} y_i = \mathbf{x}_i^T \mathbf{b} \qquad i = 1,..,N \end{align} or in matricial form: \begin{align} \mathbf{y} = \mathbf{X}^T \mathbf{b} \end{align} MLE ...
8 views

### In the case described below, should regression coefficients be reported?

I am conducting a simple moderation analysis with a continuous predictor X, an ordinal moderator M, and a continuous outcome Y variable. X was found to have a significant effect on Y, but M did not ...
7 views

### Error in svd(A) : a dimension is zero [on hold]

Hi I was wondering could anyone please tell me why is this error in R generated? I am trying to use the spm() function in R to fit an additive model: ...
11 views

### Cohen's d in pre-post meta analysis based on means and SD

As follow up on this question:I want to incooporate studies using different continues outcome in a meta analysis using SMD. I am following this guide and I do not fully understand how to calculate the ...
11 views

### What are the differences between stochastic v.s. fixed regressors in linear regression model?

If we have stochastic regressors, we are drawing random pairs $(y_i,\vec{x}_i)$ for a bunch of $i$, the so-called random sample, from a fixed but unknown probabilistic distribution $(y,\vec{x})$. ...
12 views

### Maximum Likelihood estimation and the Kalman filter

I know the Kalman filter recursions and can derive these but what I don't really get is how to estimate the hyper parameters using maximum likelihood. I understand that when running the Kalman filter ...
11 views

### Cointegration test of stationary variables with structural breaks

I am trying to implement test of cointegration (Johansen trace and eigenvalue) between 2 variables that are stationary at first difference but after Zivot-Andrews test of unit root I found they have ...
11 views

### n/m asymptotics and logistic regression goodness of fit tests

in the case of logistic regression, say our model has $p$ covariates and we have $J$ distinct covariate patterns (distinct combinations of the values of the p covariates) and we have a total of $n$ ...
22 views

### Manually compute the regression coefficients of a multiple regression model with numerical and categorical variables

I am going to explain my question using a reproducibile toy example. I would like to regress a numerical variable using a multiple regression model with either numerical and categorical variables. I ...
7 views

### What's the definiton of background risk, from the perspective of insurance and risk? [on hold]

My teacher who teaches us to learn about the foregin professional classic articles questioned us what background risk is.HELP.
11 views

### Need a comparison method to compare original data values and data values derived from a method

I have a gene expression dataset for which I have the original data values and I have put this dataset through a few methods to test their accuracy of prediction. I need to compare the results from ...
9 views

### Dynamic Bag of Words / Features

I'm trying to implement a Bag of Features for a set of images submitted in different moments by a set of users. If the clusters change, then we need to recompute at LEAST all the "visual words" which ...
9 views

### Right & Left data censoring

I have question regarding Data Censoring Methods. Is there any link where I can find details about Left and Right Censoring? Also does anyone have any clue of Articles where someone tried to merge ...
10 views

23 views

### Machine Learning - How to use a classifier to find the most likely model

I have been learning about the use of machine learning algorithms and their application to particle physics. Now, I have some doubts concerning what to do with the results. Let me explain: imagine ...
21 views

### Where in R code should I us set.seed() function (specifically, before shuffling or after) ?

I've been using the set.seed() function to reproduce same results on multiple runs. However, I don't understand where to use the function. the reason I'm asking this is because if I use the function ...
6 views

### Dynamic regression linear models in R

I have a question regarding Dynamic regression linear models. I wonder if it is possible to implement a MLR model (in R) using 'lm' and creating lagged values of predictors and dependent variables. ...
13 views

### Paired test with 2 dependent variables

What test should I use to find out what effect an intervention has on two dependent variables? I have a test group of clinically depressed that will undergo a sports program. The program is expected ...
17 views

### How to interpret regression diagnostic plots for multiple linear regression analysis (with specific example)

I recently using the day.csv file which is downloaded from http://archive.ics.uci.edu/ml/machine-learning-databases/00275/ to build a regression model for the last column “cnt” in R. This is the ...
22 views

### How can I find the field which most affects or contributes to decision making in a machine learning algorithm?

Consider the example below. On a larger dataset, it would be fairly obvious that name and gender are not a good indicator of whether a person is an adult or a kid, and that it's age which best decides ...
7 views

### T-test or repeated measure ANOVA?

I am a Phd student in neuroscience and not so knowledgeable in statistics. I have done an experiment and am not sure if i should use repeated measures ANOVA or independent T-test. The experiment is ...
10 views

### How do I report an odds ratio approaching infinity?

I am analysing the association between several variables (e.g. sex, race, region, substance use etc.) which are categorical, to one baseline variable (past year cannabis use) which is binary ...