For future readers: the $\beta_1$ in @MichaelChirico's post is \beta_wald$\beta_\mathrm{wald}$ (the average treatment effect, in usual use), and the covariance formula follows from $E[Y|X] = \beta_0 + \beta_1 X$ without loss of generality (since X is binary).
(Apologies for the extra answer; I have insufficient reputation to comment)