Lightning Blog

May 5, 2022
•
Supercharge your training with zero code changes using Intel’s Habana Accelerator
Kaushik Bokka
Apr 19, 2022
•
Experiment with Billion-Parameter Models Faster using DeepSpeed and Meta Tensors
PyTorch Lightning Team
Apr 12, 2022
•
Bagua: A new, efficient distributed training strategy available in PyTorch Lightning
Carlos Mocholí
Apr 5, 2022
•
Announcing the Stable Accelerator and Strategy API for PyTorch Lightning
Adrian Wälchli
Mar 17, 2022
•
Flash v0.7 — Your AI Factory Just Got Better!
Ethan Harris
Nov 23, 2021
•
Improved Lightning External Loggers
PyTorch Lightning Team
Nov 18, 2021
•
Announcing the new Lightning Trainer Strategy API
PyTorch Lightning Team
Nov 16, 2021
•
Introducing LightningCLI V2
PyTorch Lightning Team
Nov 9, 2021
•
Scale your PyTorch code with LightningLite
PyTorch Lightning Team
Nov 4, 2021
•
Lightning Tutorials in collaboration with the University of Amsterdam (UvA)
PyTorch Lightning Team
Nov 2, 2021
•
Train anything with Lightning custom Loops
PyTorch Lightning Team
Oct 14, 2021
•
Sharing Flash Demos with Grid Sessions, Gradio and Ngrok
Ari Bornstein
Oct 12, 2021
•
5 Lightning Trainer Flags to take your PyTorch Project to the Next Level
Ari Bornstein
Sep 30, 2021
•
Lightning Flash now supports Meta-Learning!
Thomas Chaton
Sep 23, 2021
•
Best Practices to Rank on Kaggle Competition with PyTorch Lightning and Grid.ai Spot Instances
Jirka Borovec
Sep 21, 2021
•
Leverage Sparsity for Faster Inference with Lightning Flash and SparseML
Sean Narenthiran
Sep 14, 2021
•
Flash 0.5 — Your PyTorch AI Factory!
Ethan Harris
Sep 13, 2021
•
Hyperparameter Optimization with Grid.ai and No Code Change
Jirka Borovec
Sep 6, 2021
•
Converting Scientific Kaggle Notebooks to Friendly Python Package
Jirka Borovec
Aug 31, 2021
•
Intuitive Kaggle Task Exploration and Model Baselining
Jirka Borovec
Aug 25, 2021
•
How to Prepare your Development Environment to Rank on Kaggle
Jirka Borovec
Aug 12, 2021
•
Benchmarking Quantized Mobile Speech Recognition Models with PyTorch Lightning and Grid (part 4)
Thomas Viehmann
Aug 10, 2021
•
TorchMetrics v0.5 — NLP metrics
Nicki Skafte Detlefsen
Aug 3, 2021
•
Practical Lighting Tips to Rank on Kaggle Image Challenges
Jirka Borovec
Jul 27, 2021
•
Announcing Lightning 1.4
PyTorch Lightning Team
Jul 26, 2021
•
Fine-tuning Wav2Vec for Speech Recognition with Lightning Flash
Sean Narenthiran
Jul 22, 2021
•
Applying Quantization to Mobile Speech Recognition Models with PyTorch Lightning (part 3)
Thomas Viehmann
Jul 15, 2021
•
How to Configure a GPU Cluster to Scale with PyTorch Lightning (Part 2)
Adrian Wälchli
Jul 12, 2021
•
Best Practices for Publishing PyTorch Lightning Tutorial Notebooks
Jirka Borovec
Jul 7, 2021
•
How to Train Edge Optimized Speech Recognition Models with PyTorch Lightning (Part 2 Quantization)
Thomas Viehmann
Jul 1, 2021
•
TorchMetrics v0.4 — Introducing Multimedia Metrics
Nicki Skafte Detlefsen
Jun 24, 2021
•
Quick OSS Contribution Guide
Jirka Borovec
Jun 23, 2021
•
Distributed Deep Learning With PyTorch Lightning (Part 1)
Adrian Wälchli
Jun 21, 2021
•
Training an Edge Optimized Speech Recognition Model with PyTorch Lightning - Part 1
Thomas Viehmann
May 24, 2021
•
Lightning Flash 0.3 — New Tasks, Visualization Tools, Data Pipeline, and Flash Registry API
PyTorch Lightning Team
May 7, 2021
•
PyTorch Lightning 1.3- Lightning CLI, PyTorch Profiler, Improved Early Stopping
PyTorch Lightning Team
Apr 27, 2021
•
TorchMetrics v0.3.0 — Information Retrieval metrics and more
PyTorch Lightning Team
Apr 21, 2021
•
Training Transformers at Scale With PyTorch Lightning
PyTorch Lightning Team
Apr 20, 2021
•
How to Choose a CI Framework for Deep Learning
Jirka Borovec
Mar 12, 2021
•
TorchMetrics — PyTorch Metrics Built to Scale
PyTorch Lightning Team
Jan 10, 2021
•
5 minutes
DataLoaders Explained: Building a Multi-Process Data Loader from Scratch
Teddy Koker
Dec 10, 2020
•
4 minutes
PyTorch Lightning 1.1 - Model Parallelism Training and More Logging Options
PyTorch Lightning team
Dec 10, 2020
•
6 minutes
Introducing PyTorch Lightning Sharded: Train SOTA Models, With Half The Memory
Sean Narenthiran
Nov 2, 2020
•
6 minutes
How to get started with ML Reproducibility Challenge 2020
Ananya harsh jha
Oct 28, 2020
•
5 minutes
Train Conversational AI in 3 lines of code with NeMo and Lightning
Sean Narenthiran
Oct 19, 2020
•
7 minutes
PyTorch Lightning 1.0: From 0–600k
PyTorch Lightning team
Oct 17, 2020
•
7 minutes
3 Simple Tricks That Will Change the Way You Debug PyTorch
Adrian Wälchli Oct 17, 2020·7 min read
Sep 13, 2020
•
6 minutes
Looking Inside The Blackbox — How To Trick A Neural Network
William Falcon
Sep 10, 2020
•
5 minutes
PyTorch Lightning Bolts — From Linear, Logistic Regression on TPUs to pre-trained GANs
PyTorch Lightning team
Sep 2, 2020
•
13 minutes
A Framework For Contrastive Self-Supervised Learning And Designing A New Approach
William Falcon
Aug 27, 2020
•
8 minutes
Keeping Up with PyTorch Lightning and Hydra
Peter Yu
Aug 21, 2020
•
3 min
PyTorch Lightning 0.9 — synced BatchNorm, DataModules and final API!
PyTorch Lightning team
Aug 19, 2020
•
Effective testing for machine learning systems
Jeremy Jordan
Jul 10, 2020
•
5 minutes
How PyTorch Lightning became the first ML framework to run continuous integration on TPUs
Eden Afek
Jul 1, 2020
•
6 minutes
PyTorch Lightning: Metrics
Justus Schock
Jun 20, 2020
•
3 minutes
PyTorch Multi-GPU Metrics Library and More in PyTorch Lightning 0.8.1
William Falcon
May 12, 2020
•
5 minutes
7 Tips To Maximize PyTorch Performance
William Falcon
Mar 23, 2020
•
8 minutes
PyTorch Lightning 0.7.1 Release and Venture Funding
William Falcon
Feb 27, 2020
•
10 minutes
From PyTorch to PyTorch Lightning — A gentle introduction
William Falcon
Feb 15, 2020
•
3 minutes
Torchbearer Joins PyTorch Lightning
William Falcon
Dec 1, 2019
•
6 minutes
Converting From Keras To PyTorch Lightning
William Falcon
Nov 24, 2019
•
4 minutes
Lit BERT: NLP Transfer Learning In 3 Steps
William Falcon
Nov 15, 2019
•
7 minutes
Simplify And Scale Your PyTorch Code With PyTorch Lighting
William Falcon
Aug 5, 2019
•
6 minutes
Pytorch Lightning vs PyTorch Ignite vs Fast.ai
William Falcon
Aug 3, 2019
•
5 minutes
Trivial Multi-Node Training With Pytorch-Lightning
William Falcon
Jul 29, 2019
•
4 minutes
36 Ways Pytorch Lightning Can Supercharge Your AI Research
William Falcon
Whats new
Whats new

Community Blog

Mar 23, 2022
•
PyTorch Lightning and the Future of Open Source AI
The New Stack / William Falcon
Feb 8, 2022
•
How do you pick the right set of hyperparameters for a Machine Learning project?
Karthik Rangasai
Jan 17, 2022
•
TorchMetrics v0.7 — New NLP metrics and improved API
Daniel Stancl
Jan 6, 2022
•
Question Answering for Dravidian Languages — Hindi and Tamil
Karthik Rangasai
Nov 22, 2021
•
Announcing Lightning v1.5
PyTorch
Sep 30, 2021
•
How We Used PyTorch Lightning to Make Our Deep Learning Pipeline 10x Faster
Georgian
Aug 12, 2021
•
Introducing the Initial Release of PyTorch Lightning for Graphcore IPUs
David Norman
Jul 27, 2021
•
Getting Started With PyTorch Lightning For The IPU
Stephen McGroarty - Graphcore
Jul 15, 2021
•
Fully Sharded Data Parallel: faster AI training with fewer GPUs
FB Engineering
Jul 1, 2021
•
Complement Objective Training With Pytorch Lightning
LightTag.io
Jun 23, 2021
•
New on NGC: PyTorch Lightning Container Speeds Up Deep Learning Research
NVIDIA - Akhil Docca
Jan 14, 2021
•
Neptune-PyTorch Lightning Integration
Neptune AI Team
Dec 5, 2020
•
6 min
Neural ODEs with PyTorch Lightning and TorchDyn Effortless, Scalable Training of Neural Differential Equations
Michael Poli
Sep 27, 2020
•
29 min
EfficientDet Meets Pytorch-Lightning
Yassine Alouini
Sep 24, 2020
•
7 mins
Finding good learning rate for your neural nets using PyTorch Lightning
mtszkw
Sep 19, 2020
•
12 mins
Introducing PyTorch Forecasting State-of-the-art forecasting with neural networks made simple
Jan Beitner
Sep 11, 2020
•
13 mins
Scaling Logistic Regression Via Multi-GPU/TPU Training
Annika Brundyn
Aug 12, 2020
•
7 mins
Pytorch Lightning Machine Learning Zero To Hero In 75 Lines Of Code
Sandro Luck (DGuyAI)
Aug 10, 2020
•
11 min
TensorBoard with PyTorch Lightning
Neelabh Madan (IIT Delhi)
Aug 1, 2020
•
Use Pytorch Lightning with Weights & Biases
Lavanya Shukla, Ayush Chaurasia
Jul 28, 2020
•
6 min
Automate Your Neural Network Training With PyTorch Lightning
Erfandi Maula Yusnu, Lalu
Jul 28, 2020
•
14 min
Distributed Deep Learning with Ansible, AWS and Pytorch Lightning. Part 1
Alexander Reshytko
Jul 17, 2020
•
7 min
Video Prediction using Deep Learning and PyTorch
Andreas Holm Nielsen
Jun 2, 2020
•
5 min
Use Pytorch Lightning to Decouple Science science code from engineering code
Ayush Chaurasia
May 31, 2020
•
7 min
Productive NLP Experimentation with Python using Pytorch Lightning and Torchtext How to use Pytorch Lightning and Torchtext
Arie Pratama Sutiono
May 21, 2020
•
7 min
How I built a Face Mask Detector for COVID-19 using PyTorch Lightning
Jad Haddad
May 16, 2020
•
9 min
How To Tag Any Image Using Deep Learning With Pytorch Lightning!
Tyler Folkman
May 10, 2020
•
9 min
Getting Started with PyTorch Lightning
Neelabh Madan (IIT Delhi)
Apr 5, 2020
•
4 min
Using Optuna to Optimize PyTorch Lightning Hyperparameters
Crissman Loomis
Mar 30, 2020
•
11 min
En-Lightning Reinforcement Learning: Building a DQN with PyTorch Lightning
Donal Byrne
Mar 30, 2020
•
7 min
fastai and PyTorch Lightning are democratising AI
Dimitris Poulopoulos
Mar 23, 2020
•
13 min
Custom classifier on top of BERT-like Language Model - guide
Marcin Zabłocki
Mar 22, 2020
•
7 min
Training Neural Networks for Leela Zero With PyTorch
Peter Yu
Nov 16, 2019
•
5 min
How to fine-tune BERT with pytorch-lightning
sobamchan
Oct 10, 2019
•
4 min
Scaling Up and Down: Why we moved to PyTorch Lightning
Jeff Ling