Here's how you'd normally set these things out:
Original table of counts:
1 2 3 4
Row 1 1 3 10 6
variable 2 2 3 10 7
3 1 6 14 12
4 0 1 9 11
(though the row and column variables would normally have more specific names
An observation in cell $(i,j)$ is concordant with an observation in cell $(i',j')$ if $(i'-i)(j'-j) > 0$, and discordant if $(i'-i)(j'-j) < 0$; if that product is exactly 0, it's neither concordant nor discordant.
That is, if both the row and column index move in the same direction - both increase or both decrease, then the pair is concordant. If they move in opposite directions - one increases while the other decreases - then the pair is discordant.
[Aside: To clarify, since the explicit statement above about how to compute it wasn't sufficient - only the relative cell positions matter for whether a pair of cells is 'concordant' or 'discordant'. The counts in the cells are used to work out how much to add to the count. Your table is actually a summary table of the original data.
So your original data would look something like this:
1 1 3
2 3 3
3 4 3
4 3 1
5 3 2
6 3 4
91 2 2
92 1 3
93 3 3
94 3 2
95 2 3
96 3 4
... and what you're doing is computing how many pairs of rows in that long set of data have the row and column vars increase together or decrease together to get a concordant pair (the counts don't appear in this at all - but you get them implicitly when you take all 96 $\times$ 95/2 pairs), or how many pairs have the row and column index moving in opposite directions for a discordant pair. See this definition. But since that's not very compact, it makes sense to write it as a table of counts:
rowvar 1 2 3 4
1 1 3 10 6
2 2 3 10 7
3 1 6 14 12
4 0 1 9 11
Nevertheless, keep in mind your actual data is like that long list, and you have 4560 pairs of rows, each of which is one of concordant, discordant or neither. You're just working it out in a faster way by doing it in a table.
End of aside]
So for example, observations in cell $(2,2)$ are concordant with observations in $(1,1)$, and also $(3,3)$, $(3,4)$, $(4,3)$ and $(4,4)$, and discordant with $(3,1)$, $(4,1)$, $(1,3)$, $(1,4)$. The count for each is the product of the counts in each cell, so when looking at $(2,1)$ vs $(3,2)$ you add 2 x 6 = 12 concordant pairs.
Here I've marked the cells that are discordant with $(2,2)$ in red and the ones that are concordant in blue:
However, when counting you need to avoid counting the pairs twice (we don't "double count") - so you would look only at those cells above (lower-numbered rows) to add to the counts, because the ones in the higher numbered rows will get counted when they are the 'current' cell (the one circled in brown is the current cell we're counting):
Here we only add the cells marked in solid outline to the counts - the ones with the thin, dashed lines will be counted when we make their cells the 'current' cell.
You start with cell $(2,2)$ as the current cell and then progress to higher column and row numbers (only), working your way through the table to the right and down. Hopefully it's all clear now.