InPyTorch Lightning Developer BlogbySean Narenthiran·Nov 29, 2022Lightning Transformers 0.2 — New 🤗Tasks, Community Features and Big Model Training & InferencePairing 🤗 Transformers and Lightning has become increasingly popular, leveraging Lightning to hide away the boilerplate of your training…
InPyTorch Lightning Developer BlogbySean Narenthiran·Dec 9, 2021Part I: Simplifying Transformer Research with xFormers & LightningRecently we’ve seen a large growth in variations of the Transformer model (Efficient Transformers: A Survey). However, leveraging improved…A response icon1A response icon1
InPyTorch Lightning Developer BlogbySean Narenthiran·Sep 21, 2021Leverage Sparsity for Faster Inference with Lightning Flash and SparseMLSparseML brings GPU inference speeds to the CPU. This means substantial cost-saving, efficiency, and more options when it comes to…
InPyTorch Lightning Developer BlogbySean Narenthiran·Aug 26, 2021Fine-tune Transformers Faster with Lightning Flash and Torch ORTTorch ORT uses the ONNX Runtime to improve training and inference times for PyTorch models.
InPyTorch Lightning Developer BlogbySean Narenthiran·Jul 26, 2021Fine-tuning Wav2Vec for Speech Recognition with Lightning FlashAs a result of our recent Lightning Flash Taskathon, we introduced a new fine-tuning task backed by HuggingFace Wav2Vec, powered by PyTorch…A response icon4A response icon4
InPyTorchbySean Narenthiran·Dec 10, 2020Introducing PyTorch Lightning Sharded: Train SOTA Models, With Half The MemoryLightning 1.1 reveals Sharded Training — train deep learning models on multiple GPUs saving over 50% on memory, with no performance loss…
InTDS ArchivebySean Narenthiran·Oct 28, 2020Train Conversational AI in 3 lines of code with NeMo and LightningTrain state-of-the-art speech recognition, NLP and TTS models at scale with NeMo and Lightning
InPyTorchbySean Narenthiran·Aug 10, 2020Training DeepSpeech using TorchElasticReduce cost and horizontally scale deepspeech.pytorch using TorchElastic with Kubernetes.
Sean Narenthiran·Apr 20, 2020CORD-19-ANN: Semantic Search Engine Using S-BERTAllen Institute as a part of their open research efforts released a data dump of scholarly articles as an initiative to aid efforts in…A response icon1A response icon1
Sean Narenthiran·Jun 13, 2019Scaling DeepSpeech using Mixed Precision and KubeFlowOver the past few years at Digital Reasoning we have been developing audio analytics software to be highly effective at processing the…A response icon1A response icon1