Does bias input work like constant value in linear regression? and if bias input is not used then resulting boundary will always pass through origin?
Thanks in advance.
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It only takes a minute to sign up.
Sign up to join this communityYes, that is exactly right. The name "bias unit" is just a different name for a "constant" that would be included in regular linear (or logistic) regressions.
Just as you mention in your question, it allows the fitted line (decision boundary) not to pass through the origin.
Look at this question for greater detail: Importance of the bias node in neural networks