Reparameterization Trick

concepts · 1 notes linked

Related: Generative Adversarial Networks · Discrete Distributions · Gumbel Softmax

Notes

• Neural Networks gone wild! They can sample from discrete distributions now! — Gumbel-softmax trick enables gradient flow through discrete sampling