In terms of the description of the conditional distribution, the inverse Gaussian is more skew and has a variance that increases as a higher power of the mean (the cube rather than the square).
I'd be inclined to plot log(y) against the main predictors, though particular patterns in the predictors can easily interfere with this judgement; you may have to fit a model. One easy way to do that is take logs and fit a linear regression which should be sufficient to identify heteroskedasticity, left or right skewness and suitability of a log link all at the same time. However note that if you want to perform inference -- do hypothesis testing, or calculate confidence intervals, or predictions and prediction intervals, etc then that is going to be affected by the process of model choice (all of that looking-at-the data affects the properties of your inferences). If you can do some form of data splitting -- pull off a random subset to help identify the model - that would help avoid the problem. [[You may not need a very large subsample to choose between the models.]
If the gamma is suitable the spread shouldn't change much but if the spread still increases as you go from left to right, the inverse Gaussian might capture the variance better.
In addition, the conditional distribution of the gamma should be somewhat left skew (though may be nearly symmetric) while the inverse Gaussian will be right skew.
Here's an example where you can't necessarily tell from the plot of y vs x but you can see the difference when putting a log scale on the y-axis:
You can see that the gamma has essentially constant spread and (conditionally) left skewness while the inverse Gaussian has increasing spread and (conditionally) some right skewness.
(If the plot looks symmetric with constant spread you might perhaps consider a lognormal instead, though a gamma should still do quite well.)
The choice of link should relate to how you expect the relationship between the mean of the response and the independent variables (predictor variables) to operate (preferably from theory or a practical understanding of the process). However if you do a plot like the above, you should hope to see a straight line (but again, multiple predictors can conspire to interfere with this appraisal; it may be better to look at residuals from that log linear fit I mentioned before.