Suppose I want to turn statistical significance of 0.05 into a z-score of ~1.64
Can I use a normal distribution to convert these?
Try the quantile function of the Normal distribution:
And if you're wondering, the probability distribution function does the inverse:
Any decent numerical / statistical library or language will have these; I use R for convenience. Eg for C++ you have Boost Math.