I have a function $f: \mathbb{R} \to \mathbb{R}_+$ and I would like to estimate it. The data pairs $\{(x_i, f(x_i))\}$ arrive at different times $t$. I have two questions:
- In this case, since the codomain of $f$ is $\mathbb{R}_+$ is density estimation the same as function approximation?
- What techniques are available to approximate $f$ sequentially? I know GPs are an option but they are super expensive and probably an overkill for a 1D problem. Maybe some Gaussian Mixture Regression? I tried looking at the literature but I can't find anything that has an implementation in say python or julia.
Importantly, is this non-linear regression? What is this task called? I am so confused.