When you say "control", I suspect you mean that you have a primary variable of interest, and then you have other variables that are potential confounders. 

In the presence of a confounder, the effect size of the primary variable may appear higher or lower than it actually is (Simpson's Paradoxon / omitted variable bias). To "control" for this effect, the confounder must be added to the multiple regression (otherwise you lose the ability to infer the causal effect of the primary variable). In line with what @MindtheData discusses, see some more comments [here](https://theoreticalecology.wordpress.com/2019/04/14/mediators-confounders-colliders-a-crash-course-in-causal-inference/) on how understand causal structure in a regression setting, and which variables should and should not be added (e.g. colliders should not be added).

I disagree with the recommendation of @boulder — the causal structure determines which variables should go into the regression, regardless of significance or how they affect the estimates of other variables. Omission of confounders can lead to massive errors in inference. Other effects such as suppressors are secondary, and seldom crucial for the scientific conclusions.