Logistic regression for propensity analysis - Cross Validated most recent 30 from stats.stackexchange.com 2019-09-22T16:52:35Z https://stats.stackexchange.com/feeds/question/297704 https://creativecommons.org/licenses/by-sa/4.0/rdf https://stats.stackexchange.com/q/297704 -1 Logistic regression for propensity analysis Prav https://stats.stackexchange.com/users/173470 2017-08-13T12:47:10Z 2018-09-23T10:01:40Z <p>I have a basic question as I am new to Data Science. I have a typical problem where I need to estimate the effect of an intervention between experimental and control groups. I read propensity matching is the way to go to compare 'like' candidates and people use Logistic regression (LR) to calculate propensity scores. My basic question is, isn't LR a supervised machine learning technique? What will be my training data for LR? In other words, how can LR predict the probability of being assigned to either groups just based on some properties about the candidates?</p> https://stats.stackexchange.com/questions/297704/-/299465#299465 1 Answer by Noah for Logistic regression for propensity analysis Noah https://stats.stackexchange.com/users/116195 2017-08-23T20:40:28Z 2017-08-23T20:40:28Z <p>The test data is the training data. Logistic regression uses the observed relationships between the predictors the observed treatment assignment to estimate numerical relationships between those predictors and the probability (actually the odds) of treatment assignment. Then once you have those numerical relationships, you apply them to the same data set used to estimate the relationships to generate the predicted probabilities.</p> <p>Overfitting is not really a problem here because the goal or propensity score analysis is not good prediction but rather covariate balance (where each covariate has the same distribution across treatment groups). There actually are machine learning methods to estimate propensity scores: generalized boosted modeling is the most popular. Again, because the test data is the training data, you must impose a stopping condition other than good prediction to arrive at valid propensity scores; that stopping condition is usually a numerical summary of covariate balance. </p>