I want to study seemingly unrelated regression using Gibbs sampling for many equations. Can someone suggest some books on Bayesian approach for seemingly unrelated regression (SUR) with R examples. I am a beginner in Bayesian statistics and learn well with lots of examples.
Probably the best and most widespread book about the thematic:
- APA (6. Ausg.) Wooldridge, J. M. (2002). Econometric analysis of cross section and panel data. Cambridge, Mass: MIT Press.
Note: This is the book many universities use for teaching SUR and equation systems. It is aimed to graduate student, so you should have a solid foundation of statistics, probability and econometrics. I recommend you to buy or rent the book and put a focus on lecture 8 and lecture 9.
Rather general books for the theoretical background:
- Greene, William H. (2012). Econometric Analysis (Seventh ed.). Upper Saddle River: Pearson Prentice-Hall. pp. 332–344. ISBN 978-0-273-75356-8.
- APA (6. Ausg.) Wooldridge, J. M. (2006). Introductory econometrics: A modern approach. Mason, OH: Thomson/South-Western.
- Srivastava, Virendra K.; Giles, David E.A. (1987). Seemingly unrelated regression equations models: estimation and inference. New York: Marcel Dekker. ISBN 978-0-8247-7610-7.
Note: The second woolridge and Greene are rather intuitive and on a lower level than the book I recommended you. Srivastavas book however is more specialised as it only covers SUR and not other topics of econometrics.
A broad and theoretical overview over the topic of SUR and (bayesian regressions):
Rather specific journal articles:
- Kmenta, Jan; Gilbert, Roy F. (1968). "Small sample properties of alternative estimators of seemingly unrelated regressions". Journal of the American Statistical Association. 63 (324): 1180–1200. doi:10.2307/2285876.
- Zellner, Arnold (1962). "An efficient method of estimating seemingly unrelated regression equations and tests for aggregation bias". Journal of the American Statistical Association. 57: 348–368. doi:10.2307/2281644.
- Zellner,A. & Ando, T. (2010).Bayesian and non-Bayesian analysis of the seemingly unrelated regression model with Student-t errors, and its application for forecasting International Journal of Forecasting, vol. 26, issue 2, pages 413-434
- Gao, C. and Lahiri, K. (1999), “A Comparison of Some Recent Bayesian and Non-Bayesian Procedures for Limited Information Simultaneous Equation Models,” 39 pp., paper presented to American Statistical Association Meeting, Baltimore, Maryland, August,
- Tsurumi, H. (1990), “Comparing Bayesian and Non-Bayesian Limited Information Estimators,” in Geisser, S., Hodges, S., Press, J. and Zellner, A. (eds.), Bayesian and Likelihood Methods in Statistics and Econometrics, Amsterdam: North-Holland, 179-207
- van der Merwe, A. and Viljoen, C. (1998), “Bayesian Analysis of the Seemingly Unrelated Regression Model,” Dept. of Math. Statistics, U. of the Orange Free State U., presented to the South African Statistical Association Meeting, Nov. 1998
Note: This journal articles focus rather on theory than on implementation in R. If you are looking for a Journal articles including implementation in R you might have a look at the Journal of Statistical Software. The paper from Zellner & Ando(2010) is probably the most specific and precise answer to your question. As the topic of SUR has been a topic in research constantly since the early 1960s this paper which is from 2010 should also give you a broad range of references to other literature
Examples in R:
- Kleiber, Christian; Zeileis, Achim (2008). Applied Econometrics with R. New York: Springer. pp. 89–90. ISBN 978-0-387-77318-6.
- Vinod, Hrishikesh D. (2008). "Identification of Simultaneous Equation Models". Hands-on Intermediate Econometrics Using R. World Scientific. pp. 282–88. ISBN 978-981-281-885-0.
- Package vignette "systemfit"
- Ressources from UCLA
Note: You might browser through the webpage of statistical consulting at UCLA and you might find other useful examples of implementations in R. Also note that such specific microeconometric topics are often not yet implemented in R. In Microeconometrics (e.g. SUR) Stata is still a widespread language.
I recommend to use either the
systemfit package in
R or the
sureg package in
Stata both packages are fine. Henningsen and Hamann describe in their paper several advantages of the
Although systems of linear equations can be estimated with several other statistical and econometric software packages (e.g., SAS, EViews, TSP), systemfit has several advantages. First, all estimation procedures are publicly available in the source code. Second, the estimation algorithms can be easily modified to meet specific requirements. Third, the (advanced) user can control estimation details generally not available in other software packages by overriding reasonable defaults
Therefore I think both
R are valid options for these topics. However as far as I know SUR is mainly applied in microeconometric research and among those researches Stata is the mainly used tool. It is also possible to use other statistical software such as limdep, SAS or Eviews, but I don't know of any advantages of these implementations.Personally as I am mainly using R I would also use R for SURs. ;-)
@Ferdi (+1) has some good references on the SUR approach. Ed Greenberg, Introduction to Bayesian Econometrics has a specific Bayesian focus in Chapter 9.