All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
7 views

Large Dataset vs small Splitted Dataset for XGBoost [closed]

I have a Promotions Dataset consisting of around 500,000 records for each retailer. Owing to the nature of the project, I have chosen XGBoost Algorithm. Now, what would be a good approach:- a) Train ...
0
votes
1answer
33 views

Logistic regression - what is the example interpretation of standardized odds ratio?

Let's have an example: The model is used to classify outcome (won, lost). variable_1 is having std_coefficient of 1.610 and std_odds_ratio of 5.003 variable_2 is having std_coefficeint of -2.675 and ...
1
vote
1answer
16 views

Train autoencoder to reconstruct 2D Gaussian data

I am trying to train an autoencoder to reconstruct 2D Gaussian data. These datapoints are simply sampled from Gaussians with means and covariances chosen randomly. An illustration of what I am trying ...
0
votes
0answers
8 views

Multiple linear regression - Mixed Independent Variables (Categorical and Continuous)

I'm working to improve my knowledge in predictive models. I would like to build a multiple Linear Regression by using Excel as a first step if possible. if not I'm open to solutions with R or Python. ...
1
vote
0answers
9 views

What statistical test would be best for determining if one group is directly correlated to another?

I have to determine if temperature values are the direct cause of three groups, low, medium, and high. I would assign each of these groups a number, low would be 1, medium 2, and high 3, so the data ...
0
votes
1answer
19 views

Survival Analysis - Right Censoring Data

I am using Survival Analysis to build an attrition model. I have a data set with ~15,000 people that spans the past 5 years. Approx. 2,000 left in the last 5 years. The remaining people stayed at the ...
0
votes
0answers
26 views

Spatial Binomial Probability (Darts Question)

Suppose a dart board divided into four quadrants and suppose $N$ darts are thrown with some unknown probability distribution. Let $p_1$ be the probability the darts fall in the two upper quadrants, $...
0
votes
0answers
9 views

Are the Generalized Least Square (GLS) and Maximum Likelihood (ML) two different ways of estimation?

I was taught, that OLS and ML are two different ways of estimation. ML gives OLS estimates under met assuptions, but it doesn't change the fact the two approaches differ. If so, how is that possible ...
1
vote
3answers
28 views

Likelihood that a sample is from one of two known distributions

I start with exactly two, mutually-exclusive populations, each with a distribution along a single parameter: Let's say the height of males and female persons. Now a new person shows up. By measuring ...
1
vote
1answer
21 views

Neural network derivative with respect to input

My question is how to differentiate a feedforward neural network with respect to an input? I have a network with two hidden layers: the first one has 20 neurons, the second one - 10. The output is a ...
0
votes
0answers
11 views

Statistical Test for Trends in Samples from a Possibly Changing Distribution

I have some data of quantitative measurements of the language in books from the years 1800 to 2000. For each year I have between 0 and 50 samples, mostly about 10 samples per year. If I bin the data ...
1
vote
0answers
17 views

What are the basic statistics to describe tensor data distribution

For numeric data, the basic/straightforward way to describe its distribution is to use some metrics like mean, min, max, std et al. What about tensor data (vectors and high dimensional data)? Of ...
1
vote
0answers
20 views

How to deal with different opinions in statistics and data analysis? [closed]

As I see it, there are a gap between theoretical work in statistics and real-world data analysis; and differences in opinions among applied statisticians with regards to their approaches to data ...
0
votes
0answers
7 views

Does the t-copula capture serial nonlinear dependence?

Say $\mathbf{Y}=[y_1,\cdots,y_n]'$ with elements that are uncorrelated, yet serially dependent. As a result, in the literature, the means of allowing for nonlinear serial dependence for processes ...
0
votes
0answers
7 views

Cluster a set of strings based on similarity while optimizing redundancy

The goal is to cluster a set of strings based on similarity while optimizing redundancy. Example: ...
0
votes
0answers
10 views

Solve Non Linear Programming problems Pratically [migrated]

In an exam, I studied Theoretical approaches to converting constrained minimum problems into unconstrained minimum problems. Specifically: KKT conditions Projection Gradient Descent Penalty and ...
0
votes
0answers
14 views

Can I redefine a non-random sample as a population?

I'm trying to catalog into a time series of incidents of a certain occurrence, primarily through online news articles, in order to gauge public awareness of a related issue. There is obviously no way ...
0
votes
0answers
18 views

After Deep Learning Hyperparam tuning, what adjustments should be made when dataset size is scaled up?

I'm dealing with a fully connected NN, and I'm wondering if there are any rules of thumb for adjusting hyperparameters for changes to dataset size. For example, if I increase number of obs by 20%, ...
0
votes
0answers
6 views

Keras “index_array” referenced before assignment [closed]

I'm trying to make a DCGAN with Keras, but I'm running into an error when I try to train a combined model: ...
0
votes
0answers
12 views

Feature engineering and longitudinal data

I need some advice for my feature engineering. Suppose I have 90 days follow-up data. on 12 patients and I have the vital status of the patients at the end of these 90 days (deceased=1, alive=0) ...
1
vote
1answer
35 views

Building Confidence Intervals From Monte Carlo Simulations

I have a discrete Markov process that I am running Monte Carlo simulations to estimate the distribution parameters, with the ultimate goal of producing a mean-time-to-failure (MTTF) estimate within a ...
0
votes
0answers
14 views

Interpretation of interaction effect in factorial experiment

Please help me understand how to interpret the results of full-factorial experiment with 4 factors when 1 of 2 main effects is not significant, but their interaction is significant. My dataset: ...
1
vote
1answer
14 views

How many emails would I need to train a good text extraction model?

I'm looking to train a model that will identify product names in an email that a user has bought. The end result would be something very much like named entity extraction, except this should correctly ...
0
votes
0answers
12 views

After I added Laplace Estimator to Naive Bayes [closed]

I'm using Navie Bayes algorithm to build a classifier as spam filter. Initially, I didn't use laplace estimator and got 98% accuracy. After I set laplace parameter to be 1, the prediction accuracy ...
1
vote
0answers
7 views

Using running time distributions to determine ordering probabilities in horse racing [duplicate]

For a given horse race, I have the predicted distributions of each horse running the race like below, Image taken from http://www.cms.zju.edu.cn/UploadFiles/AttachFiles/20054191750380.ppt I want to ...
0
votes
0answers
6 views

Extracting topological features from dataset - Value Error X has 24 features, but DecisionTreeClassifier is expecting 19 features as input [closed]

I'm trying to reproduce this project on my machine. Goal: get best parameters from a cross validation output load my dataset feature selection extract topological features from dataset for prediction ...
0
votes
0answers
9 views

Contrasts in LMER, one IV

I am performing my first LME. In my data set, I have one fixed factor, “Consistency” (3 levels: con, inc, pro). Subject, Passage, and Stim_set are random effects (stim set just contains a particular ...
0
votes
0answers
17 views

Bayesian r2 for negative binomial

I would like to calculate a R2 value for a Bayesian model with a negative binomial distribution. I have commands to calculate gaussian or binomial, but I was wondering if anyone knew of methods to ...
0
votes
1answer
11 views

How I can use 'time duration' as a feature in ML models? [closed]

I had two datetime columns, I subtracted them and get the duration period, how I can further use this data as a feature in ML models.
0
votes
0answers
9 views

Contradictory results between SIMPER and raw values?

I'm running a comparison of fish species communities between 6 sites at 3 locations (North, East and West) where the sites either have a reef at them (Yes, No). I found a significant effect through an ...
0
votes
0answers
17 views

How to find out what is the best predictor in a data set? [closed]

I have a dataset similar to this example Salary Goals Assists Age 100000 32 10 22 50000 12 2 25 I would like to find out which variable best predicts the salary. I tried with some regression ...
0
votes
2answers
34 views

Is it ok a threshold of 0?

I am dealing with a classification problem with a dataset containing 60k rows: 69k are negative class, and 1k is positive. I trained my models and I obtained the confusion matrices with a threshold of ...
1
vote
0answers
70 views

I don't seem to understand the components following schema from a paper concerning meta-analysis techniques [closed]

I am having trouble understanding the components of the following schema, its meaning,and how each one of them occured. Can someone give a hint or an explanation?Specifically i do not understand what ...
0
votes
0answers
10 views

Correlation structure of High Dimensional data in R

I have p>>n case, with 10K explanatory variables that I would like to partition/cluster into modules so that the correlation within groups is maximized and correlation between groups is ...
0
votes
0answers
11 views

Checking a GLM model using plots, Hoslem test and AIC

I am testing a GLM model from a set of categorical and continuous variables on the incidence of an event. I have first included all variables, then checked for co-linearity. Then did a step-down ...
0
votes
0answers
11 views

Handling 0s in a generalized linear model

I am using a generalized linear mixed model for analyzing climate data and incidence of a disease variable. The data follows a gamma distribution. But I am getting the following error when I am ...
0
votes
0answers
5 views

Calculating confidence bands with interactions in linear regression

My reviewers asked me to visualize the moderation effect in a paper, by plotting the interaction with confidence bands. In essence, I have the following simplified regression: $$y_t = \gamma_0 + \...
0
votes
0answers
12 views

How to Evaluate model's r-square after inverting from logarithmic

I stacked with question about inverting the r-square() model value after taking log1p(). My baseline LinearRegression model ...
0
votes
0answers
9 views

Estimation method [closed]

I am estimating the impact of pesticides on maize productivity using panel data for 2years. And I am not sure which method to use for estimating the cobb douglas production function with exponential ...
0
votes
0answers
12 views

Unable to install the “twosamplemr” package [closed]

I was hoping someone could point out how to resolve this problem: I first entered the following: devtools::install_github("MRCIEU/TwoSampleMR") Then lots ...
1
vote
1answer
16 views

Is it a good way to present updated model coefficients by refitting the model using both derivation and validation data?

I am conducting a research on the development and external validation of a prediction model. I have developed a regression-based prediction model using derivation set data and externally validated it ...
0
votes
1answer
24 views

GAM not actually using categorical variables?

I am very new to GAMs, but I am trying to use gam() from the mgcv package to fit a logistic regression model using cubic splines....
0
votes
0answers
13 views

Interpreting binomial glm model output, what is the estimate?

I am using regression models for the first time in R. Currently using the function summary()for the glm output. I have three variables I've put into my model ...
0
votes
0answers
27 views

How do you choose an objective function? [closed]

Say you're doing regression, how do you know RMSE is the right objective function for your problem. The typical response I get is what errors you care about, but my follow-up question to that response ...
-1
votes
0answers
10 views

I don't seem to understand the following schema [closed]

I am having trouble understanding the components and the meaning of the following schema. Can someone give a hint or an explanation?
0
votes
0answers
2 views

How use Genetic Algorithms and Particle Swarm Algorithms for Constrained Optimization? [closed]

Genetic Algorithms and Particle Swarm Algorithm are used for Unconstrained Optimization. How should they be used to solve constrained optimization problems, then solve linear programming or nonlinear ...
0
votes
1answer
28 views

What value for recall implies a logistic regression model is good?

I'm studying logistic regression using Python and about metrics to have a good model, I know this three: accuracy, precision and recall. In the same way, I was studying using a dataset about ads in ...
0
votes
0answers
11 views

How can I create a partial year dummy variable for a panel dataset?

This might be a dumb question, but here goes. I have a panel dataset that includes annual firm-level data from 2010-2020. I am interested in the effect of a specific policy change (X) in my outcome ...
0
votes
0answers
13 views

Quadratic Discriminant Analysis(QDA)

Content of the question: Reference: Solution: In the solution, I did not understand how the second thing of the right part of the equation was resolved (in the line before final result) or maybe ...
0
votes
0answers
2 views

Log Periodic Power Law estimation of turning points

Can the Log Period Power Law be used to forecast turning points. Can it estimate the point estimate, or even an interval estimate at the critical time?

15 30 50 per page
1
3 4
5
6 7
3471