Back to home
PyTorch
2 articles tagged with this topic
PyTorchFSDP
Educational PyTorch repo for distributed training from scratch: DP, FSDP, TP, FSDP+TP, and PP
A new open-source repo implements all major PyTorch parallelism strategies explicitly, without high-level framework abstractions.
Apr 123 min read
NVIDIAAITune
NVIDIA Open-Sources AITune: Auto-Selects Fastest PyTorch Inference Backend
NVIDIA releases AITune, an open-source toolkit that benchmarks and auto-picks the optimal inference backend for PyTorch models.
Apr 123 min read