For Pearson correlation coefficients, it is generally appropriate to transform the r values using a FischerFisher z transformation. Then average the z-values and convert the average back to an r value.
I imagine it would be fine for a Spearman coefficient as well.