How does a bootstrapped Games-Howell procedure work, which calculates 95% CI based on the BCa method? I'm trying to implement a bootstrapped Games-Howell procedure in MATLAB, similar to the one which is available in SPSS (see results based on test data).
To my knowledge the following can be stated, regarding the Games-Howell bootstrapped results: If the 95% BCa CIs intersect zero one can not reject the H0 but if they do not one can. The Games-Howell procedure I have already successfully implemented and it gets me essentially the same results as SPSS. 
Problem


*

*How are the bootstrapped 95% BCa CIs, which SPSS reports, calculated? Are the CIs simply based on the bootstrapped mean difference? If so, what is the Games-Howell procedure doing then, since it also calculates CIs.

*Does SPSS somehow combine the two procedures (Games-Howell and Bootstrapped BCa CIs) which both get us CIs. If so, how?


I used the following sources for the implementation of the Games-Howell procedure:


*

*IBM SPSS Statistics Algorithms 25, p. 1173

*Games & Howell (1979)
I know how to calculate the 95% BCa CIs of the mean difference but doing so got me different CIs (see results) as the one of SPSS. 
 A: Something which is obvious, however should still be stated is: Bootstrap results of two different programs (e.g. SPSS and MATLAB) can not be expected to be equal, since the random number generator and seed used by said programs are likely different.
If one selects bootstrapping and post-hoc procedures (see picture) in SPSS, SPSS does the following:


*

*It performs the selected post-hoc procedures based on the given data (see test data) and calculates the CIs which are based on said post-hoc procedures (see output file section "Post Hoc Tests - Multiple Comparisons" one can open these output files by clicking on download and then open with Firefox, Chrome, etc.). In other words the CIs calculated for the post-hoc procedures are different even if the same "groups" (i.e. 1 vs. 2) are compared. This should obviously be the case, because for example the Games-Howell procedure calculates CIs differently than Fisher's LSD.

*The Bootstrap BCa 95%CI of the mean difference for all possible comparisons are however the same for all selected post-hoc procedures (see output file section "Post Hoc Tests - Bootstrap for Multiple Comparisons") when the same seed is used. However, when using 5000 Bootstrap samples and "unchecking" the seed option, results of the Bootstrap BCa 95%CIs are exactly same (see output file2). This means that the same bootstrap samples are used for all comparisons.


The conclusion which I draw from these results is: If one selects the Bootstrap option and also a post-hoc procedure say the Games-Howell procedure. SPSS will simply report the bootstrapped BCa 95%CI of the mean difference in the "Post Hoc Tests - Bootstrap for Multiple Comparisons" section even-though it says "Games-Howell" "LSD" etc. procedure next to it. Meaning the BCa 95%CIs are unaffected by the post-hoc procedure.
