I've also asked myself this question, and this is the way I look at it:
Suppose your regression models are
Time dummies
$y_t =\alpha + X_t\beta +\sum_{j=1}^{T-1}\tau_jT_{j} +e_{it}$
where $\tau_j$ is the coefficent on dummy $T_{j}$, the latter equal to one year $j$, zero elsewhere. For any given year, you can evaluate the function by setting $T_j=1$ for $j=$ the year you evaluate, and zero elsewhere. This gives you:
$y_{t=j}=\alpha + X_j\beta+\tau_j$
Thus, you have a year-specific effect of size $\tau_j$ that affects all your units. I view this approach most appropriate if you suspect that there are specific effects to that year, and wish to model them. E.g. the quality of students in a class for a given year, might exhibit year-specific changes.
Time trend
$y_t =\alpha + X_t\beta +\lambda t +e_{it}$
where $\lambda$ is the coefficient on the time trend $t$ increasing with equal steps, e.g. years. To obtain an intepretable expression, you can take the derivate:
$\frac{\partial y_t}{\partial t}= \lambda$
So moving from one year to another, i.e. increasing $t$ by one unit, yields an effect of $\lambda$ on your outcome variable. Thus, you have a linear trend which can be intepreted as the overall direction your outcomes moves across time. You assume that the effect you estimate is not specific to any given year, but the process which generates the changes extends across years - that's at least how I think about it.
The way I see it, it's more question of what you want to estimate. Year-specific changes or trends (or you might want to compare which of these models is the most appropriate).