If you have the standard errors of the kappa values and are willing to assume they are normally distributed you could summarise them using techniques from meta-analysis. Each would be inversely weighted by its variance to form the summary and the weights used to form the standard error of the summary and hence to form confidence intervals. Meta-analysis is available in Stata and R, I would not try doing it by hand so I do not give the formulas here.
The CRAN Task View on MetaAnalysis contains more than 100 packages for some variety of meta-analysis. Disclaimer, I maintain the Task View.