Usually the exogeneity assumption is states, given the vector E[$\epsilon$|x]=0.
what this implies then is E[$\epsilon_i$|x$_i$]=0 for all i. The individual notation part is what is confusing me.
What is the intuition for the individual notation? is $\epsilon_i$ a random variable for each i, or is it just one random variable $\epsilon$,who's realizations vary with the population? are we taking the expectation over all values for individual i, or are we taking the expectation of the error across individuals?