Questions tagged [partial-least-squares]
A class of linear methods for modeling the relationship between two groups of variables, X and Y. Includes PLS regression.
237
questions
0
votes
0answers
7 views
How do you decide how many factors to choose in PLS after plotting loocv graph?
I obtained this graph from plotting errors made while doing loocv vs no. of components. As expected the pls went down to 0 error but how do I choose number of components?
I tried running the test set ...
0
votes
0answers
19 views
consistent Partial Least Squares (PLSc) for one-factor models
To date, I have only fitted Structural Equation Models (SEM) via Maximum Likelihood (ML). Looking into alternative estimation procedures, I ran into consistent Partial Least Squares (PLSc; Dijkstra &...
2
votes
1answer
60 views
Highly Correlated Datasets - Why and What Next?
I've got three datasets (of different biological data) that are highly correlated - such that if I use the typical findCorrelation from the ...
2
votes
0answers
11 views
LDA followed by multiple PLS models OR PLS2 to include both the continuous dependent variable and the categorical variable
I have 1200 spectral Xvariables.
I use PLS-LDA to reduce Xvariables and classify them in groups (contaminants).
After that I need to quantify the "amount" of contaminant by PLS.
First I ...
1
vote
0answers
35 views
Using Partial Least Squares as a generative model
0
The partial Least Squares (PLS) method is often used to model Latent Variable Regression (LVRs). At the end of the PLS algorithm, we have the loadings and scores. My question is, can we construct a ...
0
votes
0answers
12 views
Distribution of imputed values and multivariate analysis
Below you'll find two plots showing the Q-Q plot (top) and histogram (bottom) of two variables. The aim is to use them, together with others, with sPLS and other multivariate methods for regression ...
0
votes
0answers
4 views
How to get construct scores when using mode_B in R using SeminR package
I am trying to get construct scores in R using SeminR package. When I use mode_A there is no problem. I can produce scores. But with mode_B I am not able to produce scores. Can someone please explain ...
0
votes
0answers
13 views
PLS-SEM with only one latent construct
I am currently reading a paper that utilizes partial least squares (PLS) to estimate a structural equation model (SEM). What bothers me a bit is the structure of their given model in combination with ...
3
votes
1answer
56 views
The last step of PLSR
Here is the reference of NIPALS for PLSR:
https://learnche.org/pid/latent-variable-modelling/projection-to-latent-structures/how-the-pls-model-is-calculated
I cannot understand the last step, to find ...
3
votes
1answer
48 views
one dimension PLS
We know one of the definition of partial least squares (PLS) is:
$$\max\limits_{\alpha_x,\alpha_y}Cov(\alpha_x^Tx,\alpha^T_yy)$$
$$||\alpha_x|| = ||\alpha_y|| = 1.$$...
1
vote
0answers
25 views
Textbook suggestion: Multivariate Data Integration and PLS
Apparently Partial Least Squares regression is very used in my field of research. I am looking for an applied textbook that covers Multivariate Data Integration methods, especially PLS and ideally its ...
0
votes
1answer
49 views
Advanced book multivariate statistics
I am looking for a somewhat advanced book on multivariate statistics. I don't mind if there is a lot of math in it, and I prefer R above SPSS. I'm looking specifically for a book that mentions PCA, ...
0
votes
0answers
41 views
What are y_weights, y_loadings and y_rotations in sklearn PLS
The partial least squares is an algorithm that seeks to decompose two data matrices $X$ and $Y$ based on a latent structure of the form:
$$X=TP+E$$
$$Y=UQ+F$$
where $T$ and $U$ are score matrices, and ...
0
votes
0answers
50 views
Data analysis with Partial Least Square regression-Matlab
I apologize in advance if the following question may sound too general or even wrong. My problem is the following: I have two data matrices, a neural activity (nsubjects x nbrain_areas) and a set of ...
1
vote
0answers
43 views
What is the PLSR implementation in sklearn?
Having a look to the source code from sklear implementation of PLSRegression I see two differences between what they cite as ...
0
votes
1answer
18 views
Variation on partial least squares regression (PLSR) that does not assume linear relationships between variables
Partial least squares regression (PLSR) is a statistical technique that allows you to predict multiple response variables from multiple predictor variables. It works by essentially running separate ...
0
votes
0answers
14 views
PLS correlation and PLS DA
I have 400 variables that are continuous with 100 observations. I'm interested to explore the relationship of these variables with another set of variables that are in an ordinal scale (0-4). I looked ...
0
votes
0answers
49 views
PLS model performs significantly worse than chance according to permutation test
I'm using Partial Least Squares regression to relate two datasets: X has 40 variables, Y has 54 variables, both have 26 observations. Because I don't have a lot of observations, I'm using a ...
0
votes
0answers
8 views
How to settup a databas for PLS model different scenarios- same individuals
I am currently doing my Master Thesis on how the Willingness to Pay (WTP) and Purchase intention (PI) of customers is affected by the level of customization of a product; I am using PLS-SEM model.
...
0
votes
0answers
14 views
GLM on features selected by PLS-DA
First question: Can we use GLM on specific variables selected by PLS-DA latent components? To obtein p-value of response of prediction (e.g.for each selecetd variable of comp 1)?
Second question: What ...
0
votes
2answers
24 views
Multicollinearity and case:predictor ratio problems
I have 444 cases and 60ish predictors that suffer from collinearity. The predictors fall into three categories (vol, thickness and demographics). I would prefer to subdivide my cases into 4 (age) ...
0
votes
1answer
17 views
How can I summarize latent variables using PLSSEM
I am kinda new to PLS SEM, but I think I have the steps down and can interpret the results. However, I initially like to look at summary statistics of variables when a single variable measure a ...
1
vote
0answers
26 views
Do loadings in PCA describe variation around the mean?
I found this statement in one paper about statistical process control and monitoring:
The P loading matrices contain all the structural
information about how the variable measurements should deviate
...
0
votes
1answer
120 views
Noisy PLS-DA loading for a model with good performance
What does it mean to have a good PLS-DA model (in terms of both sensitivity and specificity on independent test set), but very noisy loadings (the data is IR spectrum, and it lost its spectral shape ...
4
votes
1answer
64 views
Multiple dim responding variable the relation between CCA and trivial linear regression (PLSR, CCA, PCA, PCR and Linear Regression)
Here is my summary of Multivariate Linear Regression between explain variable $\textbf{x}$ and responding variable $\textbf{y}.$ I have summaried the relation ...
1
vote
1answer
353 views
How does PLSR solve Multicollinearity
We know that PLSR is a very common way to solve Multicollinearity in the Multiple Linear Regression. But do you know how does it work in detail? And why Multicollinearity of $x$ will be related to the ...
0
votes
1answer
143 views
PLS: Find number of components for multiple dependent variables
I created a PLS model with three dependent variables using mdatools. Variable A gets the best results when using two components. However for variables B and C it would be better to use four components....
0
votes
1answer
54 views
How to interpret null or nearly null coefficients with VIP > 1 in PLSR?
I try to interpret a PLSr model that I used to predict a response variable using full range spectroscopy (500 - 2400 nm). I followed the method from Serbin et al. 2014 (https://doi.org/10.1890/13-2110....
1
vote
1answer
156 views
PLS regression - VIP treshold to exclude variables
I have been developing PLS models in the software SIMCA. To optimize the model and decide which variables to exclude, I use the VIP (Variable Importance in Projection [1,2]) and in the software ...
0
votes
1answer
68 views
PLS Regression - RMSEP minimum value
I use the plsr function in R with cross validation (10-fold). As a result, I get this output:
From my limited understanding, I know that the ideal number of components is usually chosen by the ...
4
votes
3answers
802 views
What does it mean to say that a regression method is (not) "scale invariant"?
I was just studying partial least squares regression, and I read that it is "not scale invariant". What does "scale invariant" mean, and why is partial least squares, and why would ...
1
vote
0answers
33 views
What's behind PLS regression method?
I was wondering if anyone could provide me a source with a more or less simple explanation to the PLS regression process? I have been reading this paper to help me understand what's behind the PLS, ...
0
votes
1answer
86 views
PLS-DA dependent variables
Is it possible to use more than one categorical dependent variable with partial least square discriminant analysis?
Thanks.
0
votes
1answer
19 views
PLS procedure in SAS software
experts, I have a question about PLS procedure in SAS. The manual said that the prediction on new data is by combining training data and new data (new data dont have response values).
I did ...
0
votes
0answers
49 views
Variable of importance and Q2Y in PLSR
In Partial Least Squares Regression, we can set a threshold to variable of importance scores to extract variables that have significant influence over the output. We can then reduce the model size to ...
0
votes
1answer
267 views
Explained variation in PLS vs PCA
A lot of research articles outline that the number of extracted factors by PLS (partial least squares) is less than the number of extracted factors by PCA (principal component analysis). However, the ...
1
vote
0answers
23 views
Difference between sequential/simultaneous nonlinear partial least squares and NIPALS algorithm
I've been reading about nonlinear partial least squares, and according to the below study, there are two types of NLPLS: sequential NLPLS and simultaenous NLPLS.
https://www.sciencedirect.com/science/...
1
vote
1answer
352 views
0
votes
1answer
231 views
Value for ncomp when making predictions for PLSR model
Using the seatpos dataset from the faraway package in R, I wanted to do PLS regression models with up to eight components, ...
-1
votes
1answer
131 views
Can a trained Partial Least Squares (PLS) model be used for lossy compression/encoding?
Once I have carefully trained a PLS model, I know the optimal number N of components for a regressor model.
Can those components and their coefficients be used to lossy compress the original data ...
5
votes
1answer
482 views
Combining Bootstrap and Cross-Validation
I am trying to think of ways of combining bootstrap and cross-validation (CV) to get out-of-sample prediction error and its confidence interval. I was initially thinking of applying this to partial ...
0
votes
1answer
2k views
Partial Least Squares Using Python - Understanding Predictions
I am having trouble constructing/applying a regression equation from PLS to make a prediction in a manner that can obtain the same predicted values that the model produces when calling the model....
2
votes
2answers
1k views
Difference between LDA and PLS-DA?
Could someone please help by explaining the difference between LDA and PLS-DA? Or are we talking about the same?
0
votes
0answers
24 views
If I control for country effects and results are significant, can I conclude generalizability of results?
I am working on a mediated model where M mediates the relationship between X and Y and I have one control variable. The data I am using is from 3 different countries with different sample sizes (46, ...
0
votes
1answer
1k views
(Dis)advantages of a PLS regression over PCR
I've read a lot of sources about Partial Least Squares (PLS) Regression and, based on my readings, it seems that it has some advantages over a Principal Component Regression (PCR). Different sources ...
2
votes
1answer
795 views
Moderated moderation (3-way interaction) with latent variables
I would appreciate some help in deciding the analysis method for my research.
I have 7 variables: one DV, one IV, two moderators, one moderator/moderating moderator plus 2 controls. My overall ...
0
votes
0answers
66 views
PLS regression predictions
We have the following sample containing two predictors ($x_1, x_2$) and one dependent variable ($y$).
$x_1=[-1.01, 3.23, 5.49, 0.23, -2.87, 3.67]$
$x_2=[-0.99, 3.25, 5.55, 0.21, -2.91, 3.76]$
$y=[-...
1
vote
0answers
134 views
Different PLS model when using plsr() function in R or Minitab PLS regression menu
I have a PLS model made in R with plsr() function (from package pls); I have chosen the right number of components with cross ...
0
votes
1answer
63 views
Partial Least Squares: adding unrelated variables improves fit
I am performing some simulations of partial least squares. In particular, I have 30 observations split into 20 which are for training and 10 which are for testing. I also have 23 independent variables ...
0
votes
2answers
319 views
PLSr: Generating predicted value using regression coefficient
I perform PLS with pls package in R using plsr function.
Why am I unable to get the same predicted Y value as when I use the ...
