InA paper a day avoids neuron decaybyFrancisco Ingham·May 1, 2019Day 12: Generating Long Sequences with Sparse Transformers[Apr 23, 2018] Model very long sequences in a compute/memory efficient wayA response icon3A response icon3
InA paper a day avoids neuron decaybyFrancisco Ingham·Apr 22, 2019Day 10: All You Need Is A Good Init[Nov 19, 2015] How to initialize your deep networks for any activation function
InVoice Tech PodcastbyFrancisco Ingham·Apr 5, 2019Day 9: Transformer-XL: Attentive Language Models Beyond a Fixed-Length ContextHow to improve your Transformer’s performance through increased long-term coherence by using recurrenceA response icon1A response icon1
InA paper a day avoids neuron decaybyFrancisco Ingham·Apr 3, 2019Day 9: Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context[Jan 18, 2019] How to improve your Transformer’s performance through increased long-term coherence by using recurrence
InA paper a day avoids neuron decaybyFrancisco Ingham·Mar 29, 2019Day 8: Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification…[Feb 6, 2015] How to initialize your deep ReLU activated networks to avoid vanishing and exploding gradients
InA paper a day avoids neuron decaybyFrancisco Ingham·Mar 27, 2019Day 7: Natural TTS Synthesis By Conditioning WaveNet On Mel Spectogram Predictions (Tacotron 2)[Dec 16, 2017] The key to generate human-like speech, without predefined features
InA paper a day avoids neuron decaybyFrancisco Ingham·Mar 19, 2019Day 6: Deep Voice 3: Scaling Text to Speech with Convolutional Sequence Learning[Oct 20, 2017] Real-time, high quality, multi-speaker text-to-speech inference
InA paper a day avoids neuron decaybyFrancisco Ingham·Mar 16, 2019Day 5: Conditional Image Generation with PixelCNN Decoders[Jun 16, 2016] Creating images from a vectorA response icon1A response icon1
InA paper a day avoids neuron decaybyFrancisco Ingham·Mar 15, 2019Day 4: Pixel Recurrent Neural Networks[Jan 25, 2016] Generating images with RNN’sA response icon1A response icon1
InA paper a day avoids neuron decaybyFrancisco Ingham·Mar 12, 2019Day 3: WaveNet: A Generative Model for Raw Audio[Sep 12, 2016] The key to generating human-like speech
