# Questions tagged [panel-data]

Panel data refers to multi-dimensional data frequently involving measurements over time in econometrics. It is also called longitudinal data in biostatistics.

1,069 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
1answer
1k views

### Applying machine learning techniques to panel data

I have a panel data in which I observe 1500 companies and many individuals work for those companies for multiple periods. I have explanatory variables at both individual (e.g. race, age, education) ...
0answers
147 views

### Test whether cross-sectional dependence in panel data follows known (network/spatial) structure

I want to test whether cross-sectional dependence in one specific variable (y) in panel data format follows a known structure (W) (e.g. network, spatial dependence), after controlling for individual ...
0answers
6k views

### Panel regressions with an interaction term between a time dummy variable and a time invariant variable

I have estimated the coefficients of the following equation, using the fixed-effect model: $Y_{it}=\alpha _i+ \rho _t + \beta _1 X_{it}+\beta _2 C_i*D_t+\epsilon_{it}$ I have observations from 1980 ...
0answers
261 views

### Avoiding adjustments for time-varying controls in difference-in-differences (DID)?

In difference-in-differences (DID) analysis, it seems like a "folk theorem" that one should be very wary of adjusting for time-varying controls. The reason, eminently plausible, is that ...
0answers
1k views

### Average Marginal Effects from Chamberlain-Mundlak Device CRE Probit

I am trying to calculate the average marginal effects for the Chamberlain-Mundlak Correlated Random Effects probit model. The ultimate goal is to get something equivalent to the AME from the fixed ...
1answer
5k views

### Difference-in-difference in panel data

Under which conditions should we expect the difference-in-difference estimate to be equal to the equivalent panel data model? Strictly speaking, whenever we have a experiment that offers a well ...
0answers
6k views

### When to use longitudinal (panel) weights vs cross-section weights in complex surveys

I'm currently working with a longitudinal dataset, the Kauffman Firm Survey. The survey tracks about 5000 firms starting from 2004 - 2009. Firms die out over the years. It has both cross-sectional ...
0answers
224 views

### Simple trend analysis with unbalanced & short panel data

I have the following (unbalanced) panel data: yearly sustainability ratings (ESG) of ca. 2000 individual firms over a 11-year period. The average observations per firm only covers 5.3 periods. These ...
0answers
1k views

### What are the advantages of a random effects model versus a pooled OLS regression with cluster–robust standard errors?

Both models allow for explanatory variables that are time-invariant. I had thought that the advantage of a random effects model might be related to the fact that random effects models mitigate ...
0answers
538 views

### Longitudinal mixed model: What random effects are possible?

I'm faced with analyzing the following design: In a longitudinal study, the muscle tissue of about 25 subjects are analyzed at 8 timepoints. Specifically, 7 measurements are taken during a race ...
0answers
358 views

### Machine Learning for Causal Inference with Panel Data: Possible to combine ML estimators with additive/linear terms to derive diff-in-diff estimator?

My question is motivated by the following. First consider the non-panel case, where we have two groups, the treated group ($g=t$) and the comparison group ($g=c$), and are trying to estimate an ...
0answers
769 views

### How can I control for time-varying unobserved heterogeneity with panel data?

I'm just beginning to learn econometrics, and I just learned about the fixed effects estimator, and the first-difference estimator. It's quite straightforward that those techniques allow me to control ...
0answers
1k views

### ROC curves for repeated measures

I am trying to model ROC curves for a longitudinal dataset where participants were measured between 1-13 times. Time is not of interest but the fact that the measurements are autocorrelated an issue. ...
0answers
570 views

### Is this longitudinal data too complicated for GLMM or GEE?

After writing this post, I've realized that I am running around in circles, chasing my tail. Any help approaching this problem would be greatly appreciated, as I think I just need to bounce ideas ...
0answers
1k views

### Standardizing count variables in panel data with overdispersion - R or Stata

I'm running a regression where the dependent (response) variable is a highly dispersed (slightly zero-inflated) count and the explanatory (independent or predictor) variables are continuous, counts as ...
0answers
1k views

### Structural equation model with very small samples

I have two sets of a longitudinal data that I hypothesize to measure same latent construct.I am trying to test this hypothesis using Structural equation modelling technique. Basically, I am trying to ...
0answers
4k views

### Why two-step dynamic panel data estimator is better then one-step?

Could someone please give an explanation of why two-step dynamic panel data estimator is better then one-step? Can't quiet understand it... For example, from ...
0answers
2k views

### How to correct for heteroskedasticity in fixed effects panel regression with correction for clustered standard error?

I am a student at RSM and I have a question regarding my regression analysis for my thesis as I have encountered issues I do not know how to deal with. I have performance data (dependent variable) of ...
1answer
632 views

### Dynamic panel data with large $T$

Given a data set with $N=2634$ and $T=92$, I want to estimate a dynamic model. My first though was to use a classic System GMM estimator, however digging through the literature it turned out that ...
0answers
106 views

### Dynamic panel data model with AR(2) process in the errors

I set up the following dynamic panel data model: $$y_{it}=\alpha y_{it-1}+x_{it}^T\beta+v_{it}$$ Additionally, I have the process in the errors: $$v_{it}=\rho_1u_{it-1}+\rho_2u_{it-2}+\epsilon_{it}$$ ...
0answers
51 views

### Fixed effects in linear model

I am fitting a linear model on some panel data $$y_{it} = \sigma_{cr} + x_{it}^\top\beta + \mu_i + \delta_t+ \epsilon_{it}$$ where $\mu_i$ is individual fixed effect (in the sense used in ...
0answers
147 views

### How to split longitudinal data into training and testing sets

I'm trying to model the likelihood a customer will be delinquent on their loan by next month based on their most current data at the time. Currently, I have longitudinal data and am having some ...
1answer
839 views

### Correct cross-validation procedure for single model applied to panel data

Questions What is the correct CV procedure for panel data? I've been thinking of the problem as cross-validating a model fit to multiple time series data. Is the "population informed" CV procedure ...
0answers
1k views

### Difference-in-Discontinuities Design

Recently I came across the paper written by Grembi et al. (2016) and thought the methodology employed by them, Difference-in-Discontinuities Design (a combination of Regression Discontinuity and ...
0answers
169 views

### Choosing between two available packages for multinomial logit on panel data in R

There are two available packages for estimating multinomial logit models in R, namely mnlogit and mlogit. I am wondering whether someone who used both can share his experience. Which one is better / ...
0answers
156 views

### Can I get away with using GLM models on “pseudo-panel” big N small time=T data?

Suppose I have a kind of panel data set, where we track the investment totals of a great many customers, which may be highly variable, and is measured on a monthly basis over the course of 7-10 years. ...
0answers
1k views

### How to properly use generalized method of moments (GMM) estimation with plm in R?

In the context of panel data analysis my key independent variable wage affects the response not immediately but rather over time. Therefore I would like to use some ...
0answers
1k views

### Which is the best approach? Difference in Difference with Heterogeneous Effects

I am interested in the performance of two competing approaches to estimate a treatment effect, for which one would expect heterogeneous effects. The point of origin is a treatment conducted from ...
0answers
2k views

### Which logistic model is appropriate for longitudinal data?

I have data in longitudinal or clustered format (please see the example below). My response variable is dichotomous. I want to examine which factors explains why a subject in the dataset gets Y=1. In ...
0answers
583 views

### Longitudinal data analysis where meaning and metric of response variable varies over time

Determining what factors predict change over time is a topic of investigation in many fields and there are a variety of readily implemented methods for analysing repeated measures in the same metric. ...
0answers
846 views

### How to deal with attrition problem in panel data

I'm trying to test a certain "treatment effect" with panel survey data, and facing a problem with potential attrition bias. There are some observations from the baseline years missing in the follow-up ...
0answers
348 views

### How to use glmnet with panel data?

I would like to use regularization from the package glmnet on my panel data. I have the following data: country - year - gdp - population - water usage, so for each country, I have a year in which the ...
0answers
2k views

### How to use lagged dependent variables (panel data) in practice?

Working with a panel data set with a daily time series structure I was told to include a lagged dependent variable. The dependent variable is daily electricity consumption of a medium size sample (>...
0answers
3k views

### R plm strange error when using pgmm

I have a data.frame that looks like this: ...
0answers
1k views

### Unbalanced panel data: Fixed effects?

I have an unbalanced panel dataset with N=10 firms and T=61 days. Because one variable had values outside the theoretical range I had to constrain my dataset, which left me with only 239 observations. ...
0answers
333 views

### Longitudinal paired analysis

I need your advice regarding a complicated design. I am testing data regarding new eye drops that suppose to decrease some quantitative measure. For every subject, one eye is randomly assigned with ...
0answers
273 views

### Panel data model for exports and exchange rates

Suppose I have 4 years worth of monthly panel data on: exports of widgets $y$ from home country to 12 different nations (in US dollars) nominal exchange rates $x$ for those 12 countries (in US ...
0answers
59 views

### Adjusting for experimentally-caused panel attrition when evaluating treatment effects

This question involves a questionable hypothetical scenario, but please bear with me. Suppose I ran an experiment in a coffee stand where the treatment was playing country music instead of the usual ...
0answers
130 views

### Parametric segmented or piecewise regression with heteroscedastic errors

I am fitting longitudinal data with an increase in variance over time. The standard physiological model is a bi- or tri-linear model with variable breakpoints. The estimated parameters are used to ...
0answers
282 views

### Inverse probability weighted estimation of censored longitudinal data in R?

I'm looking for a package for estimating the mean of a longitudinal response under monotone dropout using a "state-of-the-art" method based on GEEs, in R (AIPW ...
0answers
508 views

### Lag Selection Modelling 'Pseudo' Panel Data

I have what I would call a pseudo panel, where my dependent variable varies over time and space (regional death counts), but my x variable of interest does not (national wage time series). Basically, ...
0answers
1k views

### Fitting panel data with both variable and constant coefficients using R

I'm working with panel data and want to fit a model of the form: $y_{ij} = \alpha_{i} + \beta_{1i} x_{1ij} + \beta_{2i} x_{2ij} + \beta_{3} treatment_{ij} + \epsilon_{ij}$ The data consist of (...
0answers
2k views

### Random Forests / adaboost in panel regression setting

Tools such as random forests or adaboost are powerful at solving cross-sectional binary logistic problems or prediction problems where there are many weak learners. But can these tools be adapted to ...
0answers
3k views

### Panel Data: In a fixed effects model, does auto-correlation introduce bias?

Given a panel of countries over time, a fixed effects estimator makes sense to control for country-specific effects. My intuition tells me that if the dependent variable is correlated with lags of the ...
0answers
1k views

### Simulate Arellano-Bond

I have fitted a dynamic panel data model with Arellano-Bond estimator in gretl, here is the output: ...
1answer
26 views

### What's the minimum number of datapoints in order to run a diff-in-diff?

I was thinking about running a diff-in-diff with fixed effect in order to deal with a panel data experiment. The problem is that I don't know how many datapoints I need in order to the experiment be ...
1answer
58 views

### How to train Prediction model for longitudinal data, with large number of time points?

Given a longitudinal data, that has date (in month-year format) as one of the independent variables and other independent variables being Gross metric tonnes, Tensile strength(UTS), weight per unit ...
1answer
53 views

### How to choose between FE and BE model

I am reading the book: Baum, C. F. (2006). An Introduction to Modern Econometrics Using Stata (Stata Press, ed.). In particular Chapter 9 treats panel data and explains the Fixed Effect (FE) ...
1answer
414 views

### Lagged independent variable's coefficient changes when higher lags are included

I'm running a TSCS analysis with the plm library in R with which I want to explain students' performances. The data consist of approximately 1100 units and has 25 points of measurement - panel data ...