I'm trying to build a network. While creating the fully connected part in the last, Which one should we prefer: More layers that regularly reduce with heavy dropouts or fewer layers that reduce drastically with light dropouts?
x = Dense(1000, activation='relu')(image_features)
x = Dropout(0.8)(x)
x = Dense(500, activation='relu')(x)
x = Dropout(0.6)(x)
x = Dense(200, activation='relu')(x)
x = Dropout(0.5)(x)
x = Dense(100, activation='relu')(x)
or
x = Dense(500, activation='relu')(image_features)
x = Dropout(0.4)(x)
x = Dense(100, activation='relu')(x)
x = Dropout(0.4)(x)