Gumbel Softmax

concepts · 1 notes linked

Related: Generative Adversarial Networks · Reparameterization Trick · Discrete Distributions

Notes

• Neural Networks gone wild! They can sample from discrete distributions now! — Gumbel-softmax trick enables gradient flow through discrete sampling