Not yet able to comment.
What level of detail do you have about the vector fields? Presumably not an analytical formula but rather just empirical values on some grid. E.g. you know the vector field on a subset of $\alpha\mathbb Z^2$ for some small float $\alpha$.
In that case the issue is that it may be a smooth underlying function but simply appear nonsmoooth at the level you are analyzing. Like the vectorfield $v(x,y)=\langle \sin(100xy), \cos(100xy)\rangle$ would appear random on $0.01\mathbb Z^2$.
So the best you can do is a relative answer - you can tell if a vector field appears smoother than another but not in any absolute sense.
One approach would be to smooth the vector field, e.g. by sampling points in an $\epsilon$-ball and computing the mean vector. You could then calculate the sum of the magnitude of difference between the smoothed vector field and the original. A smoother-appearing vector field will be better approximated by its smoothed counterpart.
You could also look at the correlation of subsequent values (similar to the autocorrelation with lag 1) of the vector field: $\text{corr}(v(x,y),v(x+\alpha,y))$ and similarly for the y-variable.
If the vector field is more smooth, then the subsequent values should be significantly correlated.