I started to use Variational Autoencoder in a project, (and I have a hard time determining the weight for the reconstruction loss and KL-loss). I have an idea of training the VAE in two steps.:

  1. Train the network as is with a bigger weight for the KL-loss
  2. Freeze the encoder and the latent layer and train the decoder using the reconstruction loss only.

Please tell me your opinions on this method and link if you have found any similar approach


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.