0
votes
0answers
5 views

Is there a limit proportion of 0 and 1 to fit binary data using glm (link “logit”)

In relation with my other question here where I observe a strange behavior of the residuals after fitting binary data using glm/glmer, I now wonder: Are there boundaries on the proportion of 0 (or 1) ...
0
votes
0answers
4 views

Statistically significant increase in Matthew's Correlation Coefficient

Suppose I have two classification algorithms A1 and A2, and a test set of size $n$. I evaluate A1 and A2 on this test set, and get corresponding Matthew's Correlation Coefficient scores ...
0
votes
1answer
5 views

k means clustering for larger text fields

I'm a beginner in data science/machine learning and am attempting to work through some problems on my own I am running a K-means clustering on a dataset consisting of "mission statements". These can ...
0
votes
0answers
8 views

Residuals with glm / glmer don't have null mean

I am trying to fit accuracy data (taking values 0 or 1) using glmer and I am puzzled to observe that the residuals of the model don't have a null mean. Wasn't this the whole point of the ...
0
votes
0answers
5 views

Fitting AR model, multiple spikes in PACF plot

I'm trying to fit an AR model with the following ACF/PACF plots: I'm wondering what AR parameter would be most suitable for data that has this correlation structure. Specifically, how to deal ...
0
votes
0answers
6 views

Boltzmann Machine (or RBM) : importance , researchers

I have been very interested into Restricted Boltzmann Machine lately, and did quite some research & related mini-projects. I am quite curious about: 1, How important it can play its role to the ...
0
votes
0answers
6 views

Roadmap to forecasting needed! [on hold]

I'm working in R and have been trying to forecast GDP by using the spread between Treasuries and corporate bonds. I've ran into some trouble though as I don't have a clear understanding of the steps ...
0
votes
0answers
11 views

Preprocessing in predictive models

I'm trying to make a predictive model using logistic regression but before that I'm wondering what kind of explore I can do on my data to get a better understanding or even help me with the model ...
-1
votes
0answers
12 views

Alternative to self-organizing maps for image clustering

I'm thinking to use self-organizing maps (with TensorFlow) to group images of people by some characteristics (like the color of their clothes). Any experiences with SOM on such task or do you suggest ...
0
votes
0answers
6 views

MCMC diagnostics for EMC or SMC

Are diagnostics developed for MCMC (e.g. Gelman-Rubin, Geweke) suitable for output from Evolutionary Monte Carlo (EMC) or Sequential Monte Carlo (SMC)?
0
votes
0answers
8 views

Interpreting log-loss as percentage

I know that log-loss penalises models that are confident with the wrong predicted classes. Can this be translated to percentage accuracy? If not, then how do I report the error or compare it to other ...
0
votes
0answers
8 views

Whole life cost question [on hold]

Hi I have a problem with this question "Consider the following costs for a new bridge with a projected service life of 120 years: Construction cost: 10 units Programmed maintenance: 1 cost unit ...
0
votes
0answers
19 views

Correlation between several variables in different study areas

I want to test the correlation between variables considering several study areas. I aim to study habitat selection using telemetry data (locations) in five study areas, and I have variables regarding ...
2
votes
0answers
15 views

Scikit-learn's SGDClassifier code question

I have a question regarding the code of function SGDClassifier, from library scikit-learn, which implements linear ...
0
votes
0answers
4 views

VAR lag length vs Johansen cointegration test outcome?

First puzzle: I am taught that the lag order of VECM does not affect the cointegration rank because the lag order is for the differenced regressors. But, I see the contrary: I experimented with sample ...
0
votes
0answers
3 views

Is there a need to scale data before a Factor Analysis on Mixed Data using FAMD() in FactoMineR package R?

I want to do a Factor Analysis of Mixed Data using the FAMD() function in the FactoMineR package in R in order to explore a data set. The aim is to reduce the dimensions of the data set for predictive ...
1
vote
2answers
135 views

I did PCA of my dataset with two classes and here is the scatterplot; how can I tell if my dataset is learnable?

What should I look for in my PCA? I'm doing supervised learning with (unfortunately only) 2000 examples, evenly split into 1000 yes and 1000 no. Each vector is a 1000 dimensional boolean vector. I ...
0
votes
0answers
12 views

Hidden Markov Model and State Space models

I am pretty sure that Hidden Markov models are a particular instance of state-space model but I cannot understand in what they are "particular". I mean, state-space models are based on two ...
0
votes
1answer
16 views

Different results for Bayesian ANOVA in JASP and R (BayesFactor)

I computed Bayes Factors for a repeated measures ANOVA in JASP and the R package BayesFactor. There were two between-subjects groups (factor "group") with multiple measurements. However, the results ...
1
vote
0answers
4 views

Prewhitening Regressors in Lagged Time Series Regression

I'm trying to identify significant lags in a time series regression such that $Y = \beta_0X_t + \beta_1X_{t-1} + ... + \beta_iX_{t-i} + \alpha_0Z_t + \alpha_1Z_{t-1} + ... + \alpha_jZ_{t-j}$ I ...
0
votes
0answers
8 views

Multivariate Analyses of Matched Case-Control Data

I'm a medical student and working on some public health research. I'm new to the forum and I am completely stumped right now trying to figure out how to handle the issue of multivariate analysis of ...
1
vote
0answers
17 views

CCA: compute estimated (x,y)-coefficients from the output of sklearn.cross_decomposition.CCA [on hold]

Consider this token CCA (canonical correlations) example in R: ...
0
votes
0answers
21 views

Can we use MLE estimates as hyperparameters of bayesian linear regression?

Given a linear regression \begin{align} y_i = \mathbf{x}_i^T \mathbf{b} \qquad i = 1,..,N \end{align} or in matricial form: \begin{align} \mathbf{y} = \mathbf{X}^T \mathbf{b} \end{align} MLE ...
0
votes
1answer
8 views

In the case described below, should regression coefficients be reported?

I am conducting a simple moderation analysis with a continuous predictor X, an ordinal moderator M, and a continuous outcome Y variable. X was found to have a significant effect on Y, but M did not ...
0
votes
0answers
7 views

Error in svd(A) : a dimension is zero [on hold]

Hi I was wondering could anyone please tell me why is this error in R generated? I am trying to use the spm() function in R to fit an additive model: ...
0
votes
0answers
11 views

Cohen's d in pre-post meta analysis based on means and SD

As follow up on this question:I want to incooporate studies using different continues outcome in a meta analysis using SMD. I am following this guide and I do not fully understand how to calculate the ...
2
votes
0answers
11 views

What are the differences between stochastic v.s. fixed regressors in linear regression model?

If we have stochastic regressors, we are drawing random pairs $(y_i,\vec{x}_i)$ for a bunch of $i$, the so-called random sample, from a fixed but unknown probabilistic distribution $(y,\vec{x})$. ...
1
vote
0answers
12 views

Maximum Likelihood estimation and the Kalman filter

I know the Kalman filter recursions and can derive these but what I don't really get is how to estimate the hyper parameters using maximum likelihood. I understand that when running the Kalman filter ...
0
votes
0answers
11 views

Cointegration test of stationary variables with structural breaks

I am trying to implement test of cointegration (Johansen trace and eigenvalue) between 2 variables that are stationary at first difference but after Zivot-Andrews test of unit root I found they have ...
1
vote
1answer
11 views

n/m asymptotics and logistic regression goodness of fit tests

in the case of logistic regression, say our model has $p$ covariates and we have $J$ distinct covariate patterns (distinct combinations of the values of the p covariates) and we have a total of $n$ ...
1
vote
1answer
22 views

Manually compute the regression coefficients of a multiple regression model with numerical and categorical variables

I am going to explain my question using a reproducibile toy example. I would like to regress a numerical variable using a multiple regression model with either numerical and categorical variables. I ...
0
votes
0answers
7 views

What's the definiton of background risk, from the perspective of insurance and risk? [on hold]

My teacher who teaches us to learn about the foregin professional classic articles questioned us what background risk is.HELP.
0
votes
1answer
11 views

Need a comparison method to compare original data values and data values derived from a method

I have a gene expression dataset for which I have the original data values and I have put this dataset through a few methods to test their accuracy of prediction. I need to compare the results from ...
0
votes
0answers
9 views

Dynamic Bag of Words / Features

I'm trying to implement a Bag of Features for a set of images submitted in different moments by a set of users. If the clusters change, then we need to recompute at LEAST all the "visual words" which ...
0
votes
0answers
9 views

Right & Left data censoring

I have question regarding Data Censoring Methods. Is there any link where I can find details about Left and Right Censoring? Also does anyone have any clue of Articles where someone tried to merge ...
0
votes
0answers
10 views

Testing a non-AR time series for mean reversion

If one discretizes Heston's dynamics for the instantaneous variance of the stock price, one gets the following time series : $$ V_k - V_{k-1} = a + b V_{k-1} + c \sqrt{V_{k-1}} \mathcal{N} \left( 0, ...
2
votes
0answers
20 views

Scale a set of probabilities so their sum is a target value

I have a set of probabilities; e.g. $p = (0.95, 0.9, 0.6)$ I want to scale them up so that their sum moves from $\sum p = 2.45$ to $\sum p^* = 2.5$. I think I need normalise to ensure the rescaled ...
0
votes
0answers
11 views

fitting a dynamic bayesian model to irregular time data

I have a dynamic epidemiological model which I solve with scipy's ODEint and fit to my data using pymc. My data is irregular in ...
1
vote
0answers
15 views

How to Graph Moderation Effects on SPSS

I am conducting an independent research but am completely stuck on how to visualize my data. So I am looking for a moderation effect of peer sociometrics (ex. negative nominations, social ...
1
vote
0answers
20 views

How many observations to estimate a parameter of an Archimedean copula?

Let's consider for example the bivariate Gumbel copula. $$C(u_1, u_2)=exp \left[-\left((-ln(u_1))^{\theta}+(-ln(u_2))^{\theta}\right)^{\frac{1}{\theta}}\right]$$ In R there are some functions (such as ...
0
votes
1answer
23 views

Machine Learning - How to use a classifier to find the most likely model

I have been learning about the use of machine learning algorithms and their application to particle physics. Now, I have some doubts concerning what to do with the results. Let me explain: imagine ...
0
votes
2answers
21 views

Where in R code should I us set.seed() function (specifically, before shuffling or after) ?

I've been using the set.seed() function to reproduce same results on multiple runs. However, I don't understand where to use the function. the reason I'm asking this is because if I use the function ...
0
votes
0answers
6 views

Dynamic regression linear models in R

I have a question regarding Dynamic regression linear models. I wonder if it is possible to implement a MLR model (in R) using 'lm' and creating lagged values of predictors and dependent variables. ...
1
vote
0answers
13 views

Paired test with 2 dependent variables

What test should I use to find out what effect an intervention has on two dependent variables? I have a test group of clinically depressed that will undergo a sports program. The program is expected ...
1
vote
0answers
17 views

How to interpret regression diagnostic plots for multiple linear regression analysis (with specific example)

I recently using the day.csv file which is downloaded from http://archive.ics.uci.edu/ml/machine-learning-databases/00275/ to build a regression model for the last column “cnt” in R. This is the ...
0
votes
1answer
22 views

How can I find the field which most affects or contributes to decision making in a machine learning algorithm?

Consider the example below. On a larger dataset, it would be fairly obvious that name and gender are not a good indicator of whether a person is an adult or a kid, and that it's age which best decides ...
0
votes
0answers
7 views

T-test or repeated measure ANOVA?

I am a Phd student in neuroscience and not so knowledgeable in statistics. I have done an experiment and am not sure if i should use repeated measures ANOVA or independent T-test. The experiment is ...
0
votes
0answers
10 views

How do I report an odds ratio approaching infinity?

I am analysing the association between several variables (e.g. sex, race, region, substance use etc.) which are categorical, to one baseline variable (past year cannabis use) which is binary ...
0
votes
0answers
10 views

Checking Multivariate Gaussian (normal) distribution before applying LDA

I have a data set with multiple predictors. I want to apply Linear Discriminant analysis (LDA) on my data. But before doing that I must confirm that my data is from multivariate Gaussian Distribution ...
0
votes
1answer
9 views

Dealing with missing data in Repeated Measures ANOVA

Hi :) I have a data set of comprised of: different subjects, each tested within subject (three time points) on a continuous scale, on various (unrelated) dependant measures. Some of these subjects ...

15 30 50 per page