Linked Questions

49 votes
6 answers
22k views

Are neural networks better than SVMs?

For some time now I have been studying both support vector machines and neural networks and I understand the logic behind each of these techniques. Very briefly described: In a support vector machine,...
Alberto Cindario's user avatar
28 votes
6 answers
6k views

Is a neural network essential for deep learning?

I received preliminary materials on deep learning in my class. It was written as follows. This raised me the question of the basic meaning of the word deep learning. Deep learning is a machine ...
desertpureolive's user avatar
32 votes
3 answers
15k views

Is logistic regression a specific case of a neural network?

I ended up in a debate regarding logistic regression and neural networks (NNs). Is it wrong to say that logistic regression is a specific case of a neural network? I have seen a lot of explanation in ...
Nikaido's user avatar
  • 812
9 votes
3 answers
3k views

Can a neural network learn "a == b" and "a != b" relationship, with limited data?

For example, I have the following feature set: {a:1, b:1} -> 1 {a:2, b:2} -> 1 {a:3, b:3} -> 1 {a:1, b:2} -> 0 {a:4, b:6} -> 0 {a:3, b:5} -> 0 ...
WindChaser's user avatar
15 votes
2 answers
1k views

Why do CNNs conclude with FC layers?

From my understanding, CNNs consist of two parts. The first part (conv/pool layers) which does the feature extraction and the second part (fc layers) which does the classification from the features. ...
Mary93's user avatar
  • 423
3 votes
2 answers
3k views

What are the predictor variables in a neural network?

In a linear regression model, the predictor or independent (random) variables or regressors are often denoted by $X$. The related Wikipedia article does, IMHO, a good job at introducing linear ...
user avatar
7 votes
2 answers
366 views

What do neural networks offer that traditional non-linear statistical models do not offer?

I have tried to find an answer to this question but have not found a satisfactory answer. I understand that neural networks(NNs) offer the potential to complex build non-linear models. What I don’t ...
Guddi's user avatar
  • 81
1 vote
1 answer
2k views

Combining Random forest with Adam (or an other gradient method)

There is no "gradient" in the standard Random Forest formulation, but can I combine random Forests with an optimisation method like Gradient Descent or SGD? Can I use Adam (Adaptive moment estimation)...
Ferdi's user avatar
  • 5,257
4 votes
1 answer
411 views

What is the definition of layer in neural network?

What is the precise definition of layer in neural network? Are things like concatenate functions, activations, batch normalizations, skip connections considered as layers?
Tim's user avatar
  • 141k
1 vote
2 answers
278 views

Is there a fundamental difference between artificial neural networks and "other" supervised machine learning models

I would like to link three of these resources, present my understanding of what I read, and pose the question if my understanding is approximately correct Is Machine Learning glorified curve fitting ...
user avatar
0 votes
1 answer
60 views

Meaning of Neural Network Doesnt Imply More Structure on the Model

I am watching a video on Thompson Sampling for Machine Learning and at [16:38] the presenter mentions that we can use various models to fit the data, (such as Gaussian Process, SVM in my opinion), but ...
GENIVI-LEARNER's user avatar
1 vote
0 answers
47 views

Which classic ML algorithms can be written as neural networks?

Many classic machine learning algorithms can be reframed as simple neural networks. For instance: Linear regression can be thought of as a neural network with one linear layer with $p$ inputs and $1$ ...
Steven Gubkin's user avatar