Skip to main content
deleted 66 characters in body
Source Link

I'm trying to build a network. While creating the fully connected part in the last, a question came to my mindWhich one should we prefer: More layers that regularly reduce with heavy dropouts or fewer layers that reduce drastically with light dropouts?

    x = Dense(1000, activation='relu')(image_features)
    x = Dropout(0.8)(x)  
    x = Dense(500, activation='relu', name="Dense_RGB_500")(x)
    x = Dropout(0.6)(x)  
    x = Dense(200, activation='relu', name="Dense_RGB_200")(x)
    x = Dropout(0.5)(x)  
    x = Dense(100, activation='relu', name="Dense_RGB_100")(x)

or

    x = Dense(500, activation='relu')(image_features)
    x = Dropout(0.4)(x)  
    x = Dense(100, activation='relu')(x)
    x = Dropout(0.4)(x)  

I'm trying to build a network. While creating the fully connected part in the last, a question came to my mind: More layers that regularly reduce with heavy dropouts or fewer layers that reduce drastically with light dropouts?

    x = Dense(1000, activation='relu')(image_features)
    x = Dropout(0.8)(x)  
    x = Dense(500, activation='relu', name="Dense_RGB_500")(x)
    x = Dropout(0.6)(x)  
    x = Dense(200, activation='relu', name="Dense_RGB_200")(x)
    x = Dropout(0.5)(x)  
    x = Dense(100, activation='relu', name="Dense_RGB_100")(x)

or

    x = Dense(500, activation='relu')(image_features)
    x = Dropout(0.4)(x)  
    x = Dense(100, activation='relu')(x)
    x = Dropout(0.4)(x)  

I'm trying to build a network. While creating the fully connected part in the last, Which one should we prefer: More layers that regularly reduce with heavy dropouts or fewer layers that reduce drastically with light dropouts?

    x = Dense(1000, activation='relu')(image_features)
    x = Dropout(0.8)(x)  
    x = Dense(500, activation='relu')(x)
    x = Dropout(0.6)(x)  
    x = Dense(200, activation='relu')(x)
    x = Dropout(0.5)(x)  
    x = Dense(100, activation='relu')(x)

or

    x = Dense(500, activation='relu')(image_features)
    x = Dropout(0.4)(x)  
    x = Dense(100, activation='relu')(x)
    x = Dropout(0.4)(x)  
Source Link

More dense layers with heavy dropouts or fewer layers with light dropouts?

I'm trying to build a network. While creating the fully connected part in the last, a question came to my mind: More layers that regularly reduce with heavy dropouts or fewer layers that reduce drastically with light dropouts?

    x = Dense(1000, activation='relu')(image_features)
    x = Dropout(0.8)(x)  
    x = Dense(500, activation='relu', name="Dense_RGB_500")(x)
    x = Dropout(0.6)(x)  
    x = Dense(200, activation='relu', name="Dense_RGB_200")(x)
    x = Dropout(0.5)(x)  
    x = Dense(100, activation='relu', name="Dense_RGB_100")(x)

or

    x = Dense(500, activation='relu')(image_features)
    x = Dropout(0.4)(x)  
    x = Dense(100, activation='relu')(x)
    x = Dropout(0.4)(x)