Timeline for Is the sum of 3 bits a linearly separable task?
Current License: CC BY-SA 4.0
9 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jun 2, 2021 at 14:34 | comment | added | jaaq | Possibly. In the same assignment we had a dataset for XOR where we showed that a linear model can only be up to 75% accurate on the task, since there's no fitting hyperplane. See here. Maybe I mixed it into the sum problem without needing to, though it confused me enough to ask why sum works and xor does not. Also our example was more sophisticated, involving input spikes for SNNs and classifying input or Liquid State. Maybe breaking it down like this makes no sense, I am not sure. Maybe this MWE doesn't represent the essence of my question well. | |
| Jun 2, 2021 at 14:30 | comment | added | Arya McCarthy | I think there’s some confusion here between addition as an abstract (‘declarative’) operation between two numbers and the representation of this operation within a computer. In the former case, your model never has to learn how to do XOR on bits. Addition of two integers is available as a subroutine that the model can employ. | |
| Jun 2, 2021 at 14:27 | history | edited | jaaq | CC BY-SA 4.0 |
Add formula for sum function
|
| Jun 2, 2021 at 14:13 | answer | added | Sycorax♦ | timeline score: 4 | |
| Jun 2, 2021 at 13:53 | comment | added | jaaq | I just used the circuit as a way to try and describe what the sum function should look like, e.g. what components it has, and whether that's linear or not. Since adding integers in computing requires an XOR block and XOR is not linear separable, I came to the conclusion that the sum function must be non-linear as well. My questions is whether this is correct and why/why not. Whether a regressor or classifier is used doesn't really matter to the question, what matters is whether the problem can be solved using a linear method/approximator(e.g. LogReg). | |
| Jun 2, 2021 at 13:50 | history | edited | jaaq | CC BY-SA 4.0 |
added 170 characters in body
|
| Jun 2, 2021 at 13:37 | comment | added | whuber♦ | Could you explain what you mean by "linear classifier"? In statistics this term is never defined or described in terms of circuits, which makes it sound like you are using it in a sense unusual in statistics. | |
| Jun 2, 2021 at 13:10 | review | First posts | |||
| Jun 2, 2021 at 13:58 | |||||
| Jun 2, 2021 at 13:07 | history | asked | jaaq | CC BY-SA 4.0 |