pytorch-fsdp2
•published 2026/02/01
Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU memory or when you need DTensor-based sharding with DeviceMesh.
📦 Install Skill
Command line install
Install directly with the `skills` CLI.
npx skills add Orchestra-Research/AI-research-SKILLs/08-distributed-training/pytorch-fsdp2File Explorer
No file selected
Select a file to view its content