Skip to main content
added 7 characters in body
Source Link
Sycorax
  • 94.1k
  • 23
  • 236
  • 390

There's no reason you would not be able to apply a neural network (in Keras or any other software) using binary inputs.

Indeed, the XOR problem is a canonical example of how a neural network is useful, even when the inputs are binary. The XOR task is to have a classifier separate 4 binary datapoints into 2 categories:

$X_1$ $X_2$ $Y$
1 1 1
1 -1 -1
-1 1 -1
-1 -1 1

Drawing a single line in $X_1, X_2$ space won't separate the 2 classes of $Y$. However, using interactions among $X_1, X_2$ will. This is achievable with a neural network with a hidden layer.

In other words, interactions among input features, even binary input features, can be essential. Neural networks are one way to achieve that.

You mention logistic regression in your question. XOR can also be solved using logistic regression, if you apply and construct interactions manually. For the XOR problem, it is clear that the $X_1 X_2=Y$; logistic regression will succeed. (Though it will exhibit perfect phenomena, unless you take steps to prevent it.)

And obviously a decision tree-based model would have no difficulties with this toy problem. A single tree with two splits would fit this data perfectly.

There's no reason you would not be able to apply a neural network (in Keras or any other software) using binary inputs.

Indeed, the XOR problem is a canonical example of how a neural network is useful, even when the inputs are binary. The XOR task is to have a classifier separate 4 datapoints into 2 categories:

$X_1$ $X_2$ $Y$
1 1 1
1 -1 -1
-1 1 -1
-1 -1 1

Drawing a single line in $X_1, X_2$ space won't separate the 2 classes of $Y$. However, using interactions among $X_1, X_2$ will. This is achievable with a neural network with a hidden layer.

In other words, interactions among input features, even binary input features, can be essential. Neural networks are one way to achieve that.

You mention logistic regression in your question. XOR can also be solved using logistic regression, if you apply and construct interactions manually. For the XOR problem, it is clear that the $X_1 X_2=Y$; logistic regression will succeed. (Though it will exhibit perfect phenomena, unless you take steps to prevent it.)

There's no reason you would not be able to apply a neural network (in Keras or any other software) using binary inputs.

Indeed, the XOR problem is a canonical example of how a neural network is useful, even when the inputs are binary. The XOR task is to have a classifier separate 4 binary datapoints into 2 categories:

$X_1$ $X_2$ $Y$
1 1 1
1 -1 -1
-1 1 -1
-1 -1 1

Drawing a single line in $X_1, X_2$ space won't separate the 2 classes of $Y$. However, using interactions among $X_1, X_2$ will. This is achievable with a neural network with a hidden layer.

In other words, interactions among input features, even binary input features, can be essential. Neural networks are one way to achieve that.

You mention logistic regression in your question. XOR can also be solved using logistic regression, if you apply and construct interactions manually. For the XOR problem, it is clear that the $X_1 X_2=Y$; logistic regression will succeed. (Though it will exhibit perfect phenomena, unless you take steps to prevent it.)

And obviously a decision tree-based model would have no difficulties with this toy problem. A single tree with two splits would fit this data perfectly.

Source Link
Sycorax
  • 94.1k
  • 23
  • 236
  • 390

There's no reason you would not be able to apply a neural network (in Keras or any other software) using binary inputs.

Indeed, the XOR problem is a canonical example of how a neural network is useful, even when the inputs are binary. The XOR task is to have a classifier separate 4 datapoints into 2 categories:

$X_1$ $X_2$ $Y$
1 1 1
1 -1 -1
-1 1 -1
-1 -1 1

Drawing a single line in $X_1, X_2$ space won't separate the 2 classes of $Y$. However, using interactions among $X_1, X_2$ will. This is achievable with a neural network with a hidden layer.

In other words, interactions among input features, even binary input features, can be essential. Neural networks are one way to achieve that.

You mention logistic regression in your question. XOR can also be solved using logistic regression, if you apply and construct interactions manually. For the XOR problem, it is clear that the $X_1 X_2=Y$; logistic regression will succeed. (Though it will exhibit perfect phenomena, unless you take steps to prevent it.)