Skip to main content

Questions tagged [gan]

Generative Adversarial Networks (GANs) are neural networks that are trained in an adversarial manner to generate data mimicking some distribution.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Why a project a reshape to 4x4x1024 for DCGAN?

In the paper Unsupervised Representation Learning with Deep Convolution Generative Adversarial Networks by Radford et. al. (2015), the model described projects and reshapes a 100 valued noise vector ...
Arjun V. Arun's user avatar
0 votes
0 answers
41 views

Understanding GAN Proof

I was reading the original GAN paper, and in the proof of Proposition 2, it is states that $U(p_g, D)$ is convex in $p_g$. I'm not sure how this is implied to be convex. This comment said that it was ...
Leonhard Bosch's user avatar
0 votes
0 answers
12 views

Question about the redundance in DCGAN training

I don't understand the necessity of the redundance in the training of DCGAN. So a classical DSGAN training procedure is like this: My questions: Can I remove step (7)-(8) and and reuse the fake ...
lovetl2002's user avatar
0 votes
0 answers
32 views

My WGAN-GP isn't capturing bi-modal distributed underlying data

I am training a WGAN to generate a vector of 6 data points (6 dimensional output). I plotted a correlation matrix of my dataset to see the underlying distribution of the 6 data points, and the ...
ShrHon's user avatar
  • 1
0 votes
0 answers
15 views

Increasing the clarity in the tasks of image generation using CNN

What methods exist to improve the quality of generated images and the clarity of contours in the tasks of image denoising/debluring (using CNN), style transfer etc? I am interested in approaches that ...
Alimagadov K.'s user avatar
4 votes
1 answer
98 views

Meaning of the notation $ \mathbb{E}_{x\sim \mu_{\text{ref}}, y\sim \mu_D(x)}[\ln y] $ in GAN framework

A very naive question about notations used in mathematical framework for generative adversarial network (GAN). What is precise mathematical definition of terms like $$ \mathbb{E}_{x\sim \mu_{\text{...
user267839's user avatar
0 votes
0 answers
20 views

cGAN: Discriminator loss going to zero while Generator's going always up but the result is very good

I have a Conditional Generative Adversarial Network for Quantum State Tomography. The metrics I am monitoring during the training process are the losses and the Fidelity (the degree of similarity ...
Dimitri's user avatar
  • 15
0 votes
0 answers
9 views

GAN training: Why not wait for the G or D to catch up?

It is known, that GANs are hard to train. ... and it proved to be very easy that one of the two overpowers the other early in the training process (Quote from here) I was wondering, why this isn't ...
Klops's user avatar
  • 156
0 votes
0 answers
32 views

How to Change Architecture of DCGans?

https://pytorch.org/tutorials/beginner/dcgan_faces_tutorial.html I was refering this notebook but default size is 64*64 I want to change architecture to 256 or 512 Can anyone help me with training ...
user20332627's user avatar
0 votes
0 answers
648 views

How to calculate FID for a set with a small number of images?

I need to evaluate my generative model using FID (Fréchet inception distance). However, the dataset of real images that I have only contains 2719 examples. I've read that the authors of the metric ...
nietoperz21's user avatar
0 votes
0 answers
14 views

Trying to understand CGAN loss curves

I am trying to understand the loss curves of a CGAN model better. From what I've seen so far, it seems like there is no consistent answer as to what the loss curves should look like. Some tutorials ...
weirdlink's user avatar
0 votes
0 answers
167 views

Discriminator and Generator's losses in a GAN

I'm a little confused about the Generator's and Discriminator's losses while training a cGAN. I am aware that a stable GAN is one where the Discriminator's loss reaches 0.5. I know that we can read ...
Dimitri's user avatar
  • 15
0 votes
0 answers
19 views

How to improve the expressibility of a cGAN

I am training a cGAN on the problem of reconstructing a density matrix. My inputs to the network are matrices and expectation values. That is, I have a set $(A,x)$ where A are measurement operators, ...
Dimitri's user avatar
  • 15
0 votes
0 answers
4 views

image gap filling using GAN and ancillary datasets

I have several daily single band images (with reflectivity values). there are several gaps in these images. To fill the gaps, I collected several ancillary datasets (including surface temperate ...
Mina's user avatar
  • 1
0 votes
1 answer
22 views

distributions in "A Note on the Inception Score" [closed]

I'm reading the following paper A Note on the Inception Score. IS is a evaluation metric for GAN. While reading the paper I got very confused about the notation of so called distributions. I will ...
greedsin's user avatar
  • 103
1 vote
0 answers
210 views

Keras RMSProp what is the alternative to "decay" (no longer available after Keras 2.3)

Background: Hello, I'm creating a GAN with an RMSProp optimizer for both discriminator & generator. The generator model has half the learning rate of the discriminator (1e-4) and half the decay of ...
carsof's user avatar
  • 11
2 votes
2 answers
55 views

Implementing loss function for training GAN

I am trying to understand the implementation of the following loss function in training Discriminator part. Loss function maximize log(D(x)) + log(1 - D(G(z))) ...
batuman's user avatar
  • 483
4 votes
2 answers
246 views

Using Generative Adversarial Networks for joint distribution estimation

I am trying to use GAN model to generate N-dimensional samples with joint probability distribution that looks like some training data. I am having trouble getting the probability distribution of the ...
dvd8719's user avatar
  • 55
4 votes
0 answers
199 views

Numerical data imputation: Generative Adversarial Imputation Nets (GAIN) not reproducible?

I am interested in numerical data imputation problems: how to properly estimate missing values in a tabular data set (rows and columns) with missing numerical values? In 2018, Yoon et al. proposed the ...
Florian Lalande's user avatar
6 votes
1 answer
2k views

GAN : Why does a perfect discriminator mean no gradient for the generator?

(Note : this is a cross-post from Artificial Intelligence. As I got no answer there in two weeks, I'm trying my luck on a more popuplated SE site. I know this is against SE's policy on cross-posting ...
Soltius's user avatar
  • 1,366
0 votes
0 answers
42 views

How does changing GAN training method afftects the GAN?

I am training a GAN in which I am optimizing or reducing the loss of the generator and the discriminator simultaneously. However, the images generated are very noisy. What could be the hidden reason? ...
Jeet's user avatar
  • 101
1 vote
2 answers
539 views

Generating synthetic time series data with limited data

I would like some opinions on my current situation. I have a set of time series data that I want to forecast. The data however is not very long (around 500 rows) so I was looking into generating many ...
codinator's user avatar
  • 123
1 vote
1 answer
305 views

Does Discriminator in GAN Train only on Real Data or it also Trains on Fake Generated Data

I have been studying GANs and I got confused in the training phase from the discriminator. Which I think only trains on Real data, not on the generated data which then helps in distinguishing or ...
Muhammad Wasil Shahzad's user avatar
1 vote
0 answers
813 views

How can Discriminator and Generator loss both move to 0?

I have been working with GANs for years and I still can't figure this out. A common thing I see is when the loss of both G and D are near zero. I usually use MSE or cross entropy loss. Shouldn't this ...
Frobot's user avatar
  • 2,171
1 vote
0 answers
120 views

CycleGAN cycle loss

I was reading the paper of CycleGAN and I was trying to implement it. However, my models does not converge to any good solution whatsoever, and since I've checked the implementation many times, I ...
Alberto's user avatar
  • 1,217
0 votes
0 answers
241 views

What's GAN's Input-size Limitations?

I am interested in GAN for generating synthetic data. I am studying the input limitations for GAN starting from which GAN is no longer usable. I have found many applications that use GANs for ...
AbdelKh's user avatar
  • 101
1 vote
0 answers
35 views

Conditional GAN training

Quite a simple question about this paper: How is the cGAN trained? I'm interested in the Pix2Pix network In particular, given the batch approach, given a specific step, is this the correct procedure? ...
Alberto's user avatar
  • 1,217
0 votes
0 answers
29 views

Pix2Pix facede dataset, prevent "gray" in dataset to be predicted

I'm trying to build from scratch the pix2pix architecture, the one on this paper. As they did, I'm using the facade dataset, and this is one of their result: I'm particularly interested in the last ...
Alberto's user avatar
  • 1,217
1 vote
1 answer
396 views

GAN artifacts on borders

not quite a math-question, but I have a doubt. I'm trying to build from scratch the Pix2pix network, on the facades dataset, and I think I finally got a good model (from the paper I borrowed just the ...
Alberto's user avatar
  • 1,217
0 votes
1 answer
120 views

plotting the latent space of a GAN

I am working on gans and wanted to know how I can plot the latent space of gan. Like I have a latent space of shape (50,250). So it is an n-d array of length 50 and 250 points representing each one of ...
Mr.J's user avatar
  • 1
2 votes
0 answers
124 views

Can you make a simple 2D ring with a GAN?

I am trying to model simple 2d continuous distributions with GANs. Here, I focus on a 2d distribution following a ring structure. The architecture of my networks are: ...
Florian Lalande's user avatar
1 vote
0 answers
67 views

Can I adjust the Wasserstein GAN loss function for my particular data?

I am working on building Generative Adversarial Networks for the purpose of generating synthetic flight data. The GAN will be trained on actual time-series flight data in the form of a (n,m,9) array ...
ScubaNinjaDog's user avatar
3 votes
2 answers
4k views

Should I be using batchnorm and/or dropout in a VAE or GAN?

I am trying to design some generative NN models on datasets of RGB images and was debating on whether I should be using dropout and/or batch norm. Here are my thoughts (I may be completely wrong): ...
Aditya Mehrotra's user avatar
2 votes
1 answer
891 views

Initialization of GAN discriminator

The question is pretty straightforward: how are GAN and WGAN discriminators typically initialized? I couldn't find much info on this. E.x. for GANs, I imagine you would theoretically want the ...
karolyzz's user avatar
  • 143
1 vote
0 answers
191 views

FID as a metric to evaluate the quality of synthetic datasets (Non GAN generated) for training models for a given classification task

I am working on a problem of generating synthetic data (algorithmically by blender, not using GANs) to aid the training of some CNN for a classification ask. Ideally, I want to generate an algorithm ...
Manveru's user avatar
  • 177
2 votes
0 answers
195 views

Hyperparameters tuning on GANs

I have seen this post talking about how to tune hyperparameters on GANs. I'm actually wondering, more generally, how does one go about tuning hyperparameters on GANs. Obviously you cannot (I mean you ...
FluidMechanics Potential Flows's user avatar
1 vote
0 answers
254 views

The discriminator is classifying everything as fake. What does it mean?

I am using a conditional GAN with a relativistic loss function for both generator and discriminator (https://arxiv.org/abs/1807.00734). Before I added the relativistic part, the discriminator ...
Rima's user avatar
  • 11
0 votes
1 answer
42 views

Is there such a thing as intra-sample modal collapse in GANs?

Mode collapse is a known issue in generative adversarial networks (GANs) whereby the generator only learns a subset of the real data distribution. In those cases, it only outputs variations of a small ...
Saucy Goat's user avatar
1 vote
0 answers
223 views

Why does a GAN generate samples from a random prior?

I've been reading Goodfellow et. al.'s paper on GANs and also the conditional GAN one by Mirza et. al. While relatively straight forward, I'm not sure I understand why the prior for the generator is ...
mesllo's user avatar
  • 679
1 vote
0 answers
207 views

Synthetic data generation - GANs vs Simulator?

For synthetic data generation, does the GAN perform better than a simulator? If so, what are the limitations of the simulator? If we consider Conditional GANs, we could generate data based on the ...
EngGu's user avatar
  • 111
1 vote
1 answer
81 views

Question: Optimal D notation in Generative Adversarial Network (GANs)

I am completely new to Computer Vision and how Deep Neural Networks work on images in general. In particular, I have questions on the Discriminator component of Adversarial Generative Network (GANs). ...
Huy Huynh's user avatar
2 votes
1 answer
1k views

Question about latent space for GANs

I am currently reading about GANs and I had a question about latent space. A site mentions: Latent space refers to an abstract multi-dimensional space containing feature values that we cannot ...
ianc1339's user avatar
  • 123
1 vote
0 answers
60 views

GANs training initially degrades pre-trained generator

I have an issue with the training of a GAN, which consists of a generator and two discriminators. The generator is used to generate waveforms. 1-The generator is independently pre-trained by ...
Phys's user avatar
  • 131
2 votes
0 answers
67 views

Which part of an encoder/decoder generative network is improved by adding a discriminator loss term?

Lets say you're doing a superresolution image task with "deep learning" constructs. You encode to a latent representation using some parameterized model (like a neural network), then decode ...
rajb245's user avatar
  • 141
0 votes
0 answers
54 views

What is a good approach to increase the depth of Nifti file format or Dicom file series?

I have a CT scan dataset of skull fracture consisting of multiple fractures and normal cases, the CT scans are in Dicom format. I want to do multi-class classification. But not every Dicom image ...
Ornob Rahman's user avatar
0 votes
0 answers
384 views

I need help understanding the meaning of the loss values of a WGAN with Gradient Penalty

I am currently working on training a Auxiliary Classifier Wasserstein GAN with Gradient Penalty. I based my implementation off of https://keras.io/examples/generative/wgan_gp/ (to which I added the ...
Moritz Grünbauer's user avatar
0 votes
1 answer
117 views

Generating the next heatmap in a sequence of labelled heatmaps without assuming continuity

I have a sequence of labelled heatmaps and I want to generate a new heatmap that is the 'best guess' at what the next heatmap in the sequence will look like, without assuming that the next heatmap ...
tonkotsu's user avatar
1 vote
1 answer
44 views

The motivation of the value function of the generative adversarial network

The seminal paper on the generative adversarial network, proposes to $$\min_G\max_D V(D,G)$$ where the value function $$V(D,G):=\int p_{\text{data}}(x)\ln p(D=\text{data}|x)\,dx+\int p_{\text{gen}}(x)\...
Hans's user avatar
  • 1,015
1 vote
0 answers
208 views

GAN discriminator loss randomly jumps up to over 1

I'm training my GAN, but it seems the losses (especially the discriminator loss) are quite erratic. It quickly converges to 0, but will randomly jump up to 1 or even 2-3 sometimes. I'm wondering what ...
Etrenix's user avatar
  • 11
1 vote
1 answer
32 views

How to approach making a GAN where row order does not matter

I am working on a project that has the aim of generating "recipes" which are the summation of "ingredients" (1-dimentional length N tensors, where each index is a value that ...
laseredlasergoat's user avatar

1
2 3 4 5