Currently, my approach is to split $N(\min(t, T^*))$ like the following by the law of total expectation.
\begin{align*} &E(N(\min(t,T^*))) = E(N(t \wedge T^*)) \\ = {}&E(N(t\wedge T^*) \mid t \le T^*) \cdot P(t \le T^*) + E(N(t\wedge T^*) \mid t > T^*) \cdot P(t > T^*). \end{align*}
To make it less confusing and more concrete, one could think of the target expectation as $E(N(\min(3, T^*)))$ when $t=3$. Later, generalize the solution to suit any given $t$.
The first and second parts become
\begin{align*} &E(N(t\wedge T^*)\mid t \le T^* )\\ ={}& \sum_{x = 0}^\infty x P(N(t\wedge T^*) = x\mid t \le T^*)\\ ={}& \sum_{x = 0}^\infty x \frac{P(N(t\wedge T^*) = x, t \le T^*)}{P(t \le T^*)}\\ ={}& \sum_{x = 0}^\infty x \frac{P(N(t) = x, t \le T^*)}{P(t \le T^*)}\\ ={}& \sum_{x = 0}^\infty x \frac{P(N(t) = x) P(t \le T^*)}{P(t \le T^*)}\\ ={}& \sum_{x = 0}^\infty x P(N(t) = x)\\ ={}& E(N(t)) = \lambda t; \end{align*}
\begin{align*} &E(N(t\wedge T^*) \mid t > T^*)\\ ={}& \sum_{x = 0}^\infty x P(N(t\wedge T^*) = x\mid t > T^*) \hspace{1cm}\color{red}{T^* < t}\\ ={}& \sum_{x = 0}^\infty x \frac{P(N(t\wedge T^*) = x \mid t > T^*)}{P(t > T^*)} \\ ={}& \sum_{x = 0}^\infty x \frac{P(N(t\wedge T^*) = x ,t > T^*)}{P(t > T^*)}\\ ={}& \sum_{x = 0}^\infty x \frac{P(N(T^*) = x ,T^* < t)}{P(T^* < t)} \end{align*}
by the conditional expectation.
So, the problem is $N(T^*)$ and $T^*$ are less likely to be independent; how to find the probability $P(N(T^*) = x ,T^* < t)$?