CalvinBackup/OBLITERATUS
1
0
Fork 0
mirror of https://github.com/elder-plinius/OBLITERATUS.git synced 2026-07-14 07:57:21 +02:00
Code Issues Packages Projects Releases Wiki Activity
30 Commits 1 Branch 0 Tags
main
Commit Graph

3 Commits

Author SHA1 Message Date
Stella Biderman 51f621d0a2 Save model snapshot to CPU to avoid OOM on multi-GPU setups 
The snapshot() deepcopy was cloning tensors on their original GPU
devices, doubling VRAM usage. For a 234GB model sharded across 6
A100-80GB GPUs (~39GB each), this left no room for the copy.

Now snapshot stores tensors on CPU and restore() moves them back
to each parameter's current device.
 2026-03-13 17:13:50 -04:00
pliny 1065809658 Add files via upload 2026-03-07 17:54:38 -08:00
pliny 0f6114fe87 Add files via upload 2026-03-04 12:38:18 -08:00