CalvinBackup/OBLITERATUS
1
0
Fork 0
mirror of https://github.com/elder-plinius/OBLITERATUS.git synced 2026-08-28 21:50:51 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
79b469d3dcab86e44cb2775c6b4ebe3197d7e746
OBLITERATUS/obliteratus
T
History
Stella Biderman 51f621d0a2 Save model snapshot to CPU to avoid OOM on multi-GPU setups 
The snapshot() deepcopy was cloning tensors on their original GPU
devices, doubling VRAM usage. For a 234GB model sharded across 6
A100-80GB GPUs (~39GB each), this left no room for the copy.

Now snapshot stores tensors on CPU and restore() moves them back
to each parameter's current device.
2026-03-13 17:13:50 -04:00
..
analysis
Add files via upload
2026-03-08 12:07:56 -07:00
evaluation
Add files via upload
2026-03-08 12:07:56 -07:00
models
Save model snapshot to CPU to avoid OOM on multi-GPU setups
2026-03-13 17:13:50 -04:00
reporting
Add files via upload
2026-03-04 12:38:18 -08:00
strategies
Add files via upload
2026-03-04 12:38:18 -08:00
__init__.py
Add remote SSH execution support for GPU nodes
2026-03-11 15:51:16 -04:00
__main__.py
Add __main__.py and fix remote pip install command
2026-03-12 12:56:03 -04:00
abliterate.py
Revert "Add data parallel support for PROBE stage"
2026-03-13 16:54:31 -04:00
adaptive_defaults.py
Add files via upload
2026-03-07 17:54:38 -08:00
architecture_profiles.py
Add files via upload
2026-03-07 17:54:38 -08:00
bayesian_optimizer.py
Add files via upload
2026-03-08 12:07:56 -07:00
cli.py
Revert "Add data parallel support for PROBE stage"
2026-03-13 16:54:31 -04:00
community.py
Add files via upload
2026-03-04 12:38:18 -08:00
config.py
Add multi-GPU support with --gpus flag
2026-03-12 12:35:29 -04:00
device.py
Add files via upload
2026-03-07 17:53:42 -08:00
informed_pipeline.py
Add files via upload
2026-03-08 12:07:56 -07:00
interactive.py
Add files via upload
2026-03-07 17:54:38 -08:00
local_ui.py
Add files via upload
2026-03-05 10:03:46 -08:00
lora_ablation.py
Add files via upload
2026-03-04 12:38:18 -08:00
mlx_backend.py
Add files via upload
2026-03-07 17:53:42 -08:00
presets.py
Add files via upload
2026-03-04 12:38:18 -08:00
prompts.py
Add files via upload
2026-03-04 12:38:18 -08:00
py.typed
Add files via upload
2026-03-04 12:38:18 -08:00
remote.py
Revert "Add data parallel support for PROBE stage"
2026-03-13 16:54:31 -04:00
reproducibility.py
Add files via upload
2026-03-07 17:53:42 -08:00
runner.py
Add files via upload
2026-03-04 12:38:18 -08:00
study_presets.py
Add files via upload
2026-03-04 12:38:18 -08:00
sweep.py
Add files via upload
2026-03-04 12:38:18 -08:00
telemetry.py
Add files via upload
2026-03-08 13:02:53 -07:00
tourney.py
Add files via upload
2026-03-08 13:02:53 -07:00