home/categories/machine-learning/nousresearch-hermes-agent-skills-mlops-training-pytorch-fsdp-skill-md
machine-learningdata-ai

pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

NousResearch
maintainer
NousResearch
Updated 3/12/2026
Stars
54282
Forks
7115
quick start

Installation and usage

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use pytorch-fsdp