No, these numbers do not contradict each other. It sounds like you have an understanding of what $R^2$ means: it represents the proportion of the variance in your data which is explained by your model; the closer to one, the better the fit.
The residual sum of squares (RSS) is the sum of the squared distances between your actual versus your predicted values:
$RSS = \sum\limits_{i=1}^{n}(y_i-\hat y_i)^2$
Where $y_i$ is a given datapoint and $\hat y_i$ is your fitted value for $y_i$.
The actual number you get depends largely on the scale of your response variable. Taken alone, the RSS isn't so informative.
Example:
Picture your residuals as a vertical line connecting your actual values to your predicted value (red traces in the plot below). You can imagine that if your y-axis is on a different scale, the number you get will be very different.
For instance, consider that your y-axis were kilometers, and a given point is about 0.5km away from your line of best fit. Then, the residual on that given datapoint is 0.5. However, if your scale is meters, then that same datapoint has a residual of 500. Your RSS will be much larger, but the fit does not change at all; in fact the data don't change at all either. But the RSS changes drastically.