Skip to main content
deleted 16 characters in body
Source Link
Ferdi
  • 5.3k
  • 10
  • 47
  • 64

I am currently try to use auto-encoders based deep learning for my classification problem. I have found some very nice examples from Matlab website auto-encoders example.

  1. In this example, they used 2 auto-encoders layers and a softmax layer (see the figure below). Will the deep learning community consider this structure as a 'deep' or still a 'shallow' network? I am asking because it seems to me that in recent literatures, there are many deep networks contains >10 layers.

AE structure

  1. May I ask if in general 'deeper' network will produce better classification? Or if there are any tricks to improve the classification performance for auto-encoders?

Thanks a lot. A.

I am currently try to use auto-encoders based deep learning for my classification problem. I have found some very nice examples from Matlab website auto-encoders example.

  1. In this example, they used 2 auto-encoders layers and a softmax layer (see the figure below). Will the deep learning community consider this structure as a 'deep' or still a 'shallow' network? I am asking because it seems to me that in recent literatures, there are many deep networks contains >10 layers.

AE structure

  1. May I ask if in general 'deeper' network will produce better classification? Or if there are any tricks to improve the classification performance for auto-encoders?

Thanks a lot. A.

I am currently try to use auto-encoders based deep learning for my classification problem. I have found some very nice examples from Matlab website auto-encoders example.

  1. In this example, they used 2 auto-encoders layers and a softmax layer (see the figure below). Will the deep learning community consider this structure as a 'deep' or still a 'shallow' network? I am asking because it seems to me that in recent literatures, there are many deep networks contains >10 layers.

AE structure

  1. May I ask if in general 'deeper' network will produce better classification? Or if there are any tricks to improve the classification performance for auto-encoders?
edited tags
Link
Franck Dernoncourt
  • 47.6k
  • 33
  • 179
  • 293
Source Link
Samo Jerom
  • 1.8k
  • 3
  • 24
  • 35

How 'deep' is deep for auto-encoders based deep learning?

I am currently try to use auto-encoders based deep learning for my classification problem. I have found some very nice examples from Matlab website auto-encoders example.

  1. In this example, they used 2 auto-encoders layers and a softmax layer (see the figure below). Will the deep learning community consider this structure as a 'deep' or still a 'shallow' network? I am asking because it seems to me that in recent literatures, there are many deep networks contains >10 layers.

AE structure

  1. May I ask if in general 'deeper' network will produce better classification? Or if there are any tricks to improve the classification performance for auto-encoders?

Thanks a lot. A.