InTDS ArchivebyNishant Nikhil·Sep 15, 2020Knowledge Distillation — A Survey Through TimeThrough this blog you will review Knowledge Distillation (KD) and six follow-up papers.A response icon1A response icon1
InElements of MistbyNishant Nikhil·May 23, 2018Pure as Snow by MonoGets to the peak of a mountain. Gazes at the enormity of the nature. Green trees, unseen land, vibrant air. Guided-not, spirit of ages…
InTDS ArchivebyNishant Nikhil·Mar 11, 2018Is ReLU after Sigmoid bad?There was a recent blog post on mental models for deep learning drawing parallels from optics [link]. We all have intuitions for few models…
Nishant Nikhil·Nov 12, 2017I want to write blogs, cause I know I have been embarrassed to write a lot of things in this space…I would start with my description of few songs, and like a customary warning, these are my opininons.
Nishant Nikhil·Sep 14, 2017Yet, who have left will put a smile on your face.Yet, who have left will put a smile on your face. Drops of jupiter and their own soulful glance in a stillness by a dining table of some…
InTDS ArchivebyNishant Nikhil·Sep 13, 2017PyTorch: First program and walk throughI saw that Fast.ai is shifting on PyTorch, I saw that PyTorch is utmost favourable for research prototyping. So, I decided to implement…A response icon1A response icon1
InTDS ArchivebyNishant Nikhil·Jun 14, 2017Facebook Research just published an awesome paper on learning hierarchical representationsPoincaré Embeddings for Learning Hierarchical RepresentationsA response icon5A response icon5
Nishant Nikhil·May 22, 2017Shannon Information Content, Entropy with ExamplesThis is in contituation to my previous post: Introduction to Information Theory -Hamming(7,4) Code. This discusses lecture 2 from…
InBecoming Human: Artificial Intelligence MagazinebyNishant Nikhil·May 19, 2017Introduction to Information Theory -Hamming(7,4) CodeI am self-teaching myself information theory from the awesome lectures by David MacKay on YouTube (Information Theory, Pattern Recognition…A response icon1A response icon1
Nishant Nikhil·May 11, 2017Unique DAppThis story is about an unique DApp, which is platform independent!! So we had a problem statement in our intra-college software development…
