Your discussion is correct. Imagine a set of heights and weights measured with a lot of precision (this is made up data to illustrate a point -- it really won't be like a set of real heights and weights - but notionally these are cm and kg)
There are two common ways to look at such a plot (usually in slightly different situations, but sometimes just as different ways of looking at the same data).
The first is simply to consider the bivariate distribution of which the sample (in some circumstances) might represent a randomly drawn set of bivariate observations. Specifically, the points will be more dense in regions where the bivariate density is higher. You will be able to think about the association between the variables (such as the fact that height and weight tend to increase together).
The other way is to consider the distribution of the $y$-variable conditional on the $x$-variable. (Excuse me, I'm going to be a little loose with notation to avoid obscuring the central ideas.)
If you had many people at each height, you could consider the distribution at each height. If the distributions at different $x$'s are similar apart from the mean (say), then this view could be thought of as regarding the distribution in terms of the way the means move: $m(x) = E(y|x)$, and then the distribution about the mean at given $x$ values (the distribution of $e = y - m(x)$, which will have characteristics that don't depend on $x$).
Note that $m(x) = E(y|x)$ is of the functional form you're used to thinking about.
(More generally, of course, the distribution around isn't so nicely behaved and does vary with $x$, but in many situations it's a reasonable description.)
If you don't have many at each height, you can convey a similar concept by thinking in terms of not an exact $x$, but the distribution of $y$ in a narrow strip of $x$-values, to approximate the distribution in the center of the strip.
This concept can either be conceived over a set of non-overlapping strips, or in a window that is moving across the range of $x$ (where there is overlap).
(Where $E[y|x]$ was assumed to progress linearly, we would be talking about linear regression models, at least as a general concept.)
In this discussion I have slipped back and forth between sample and population concepts, and I have done things like talk about expectations while illustrating it with what is notionally a sample mean. Hopefully the distinction between sample and population quantities remains clear enough in spite of the way I've not tried to keep them apart.
