Why even have non-informative priors? They don't provide information about $\theta$. So why use them? Why not only use informative priors? For example, suppose $ \theta \in [0,1]$. Then $\theta \sim \mathcal{U}(0,1)$ is a non-informative prior for $\theta$.