# Questions tagged [normalizing-flow]

Random variate representations based on repeated one-to-one transforms of a standard random variable which produce generative models and closed-form densities.

28 questions
Filter by
Sorted by
Tagged with
1 vote
11 views

### Can normalizing flows approximate bounded distributions in deep learning?

I’m exploring the use of normalizing flows in deep learning for generative modeling and I have a specific requirement: my target distributions are bounded (for example, between 0 and 1). I understand ...
23 views

### How to train a continuous-time normalizing flow model?

I'm confused on how we can actually train a continuous-time normalizing flow model. There are two use cases for the discrete-time (original) normalizing flows, and I've tried to outline how I would do ...
38 views

### How can we use ReLU activation in a Normalizing Flow model? More generally, is differentiable almost everywhere enough for a normalizing flow?

In some works, e.g., enter link description here normalizing flow models are considered with ReLU activation. For example, using a planar flow, $f = f_n \circ ... \circ f_1$, and each $f_i$ has the ...
1 vote
11 views

### Help finding Bayesian model with multi-modal posterior [closed]

Background: There is a paper (link) that concerns combining MCMC methods with a normalizing flow (a type of generative model). The basic idea is that the normalizing flow helps propose samples, which ...
• 31
1 vote
23 views

### At what circumstances will the difficulty for the tasks of density evaluation and sampling be different?

In this tutorial video of normalizing flow, the presenter mentioned that for the original autoregressive flow, the density evaluation is fast and the sampling is slow. In contrast, for the inverse ...
• 141
145 views

### What is the difference between copulas and normalizing flows?

The goal of normalizing flows is to produce arbitrarily complex probability-distributions from a simple distribution (usually the Normal distribution) through learning an invertible transform. Copulas ...
• 61
1 vote
53 views

### Choice of base distribution in normalizing flows for product distribution

I'm currently trying to implement a normalizing flow (NF) to efficiently sample from a product distribution $p=fg$. Contrary to most examples I've come across, I actually know how to sample ...
• 131
90 views

2k views

### Normalizing flows as a generalization of variational autoencoders?

Normalizing flows are often introduced as a way of restricting the rigid priors that are placed on the latent variables in Variational Autoencoders. For example, from the Pyro docs: In standard ...
• 299
2k views

### Normalizing flow training

I've been learning about normalizing flow. This is my understanding, and please correct me whenever I am wrong. There are $\{y_1,y_2,...,y_n\}$ samples from an unknown distribution $p_y(y)$ that we ...
• 145
1 vote
86 views

• 271
5k views

### Difference between invertible NN and flow-based NN

After a little bit of reading on these two terms, I have the impression they are used for the same thing. So is there actually a difference between these two concepts, and if so, how are they ...
• 583