Stella Biderman 51f621d0a2 Save model snapshot to CPU to avoid OOM on multi-GPU setups ...

The snapshot() deepcopy was cloning tensors on their original GPU
devices, doubling VRAM usage. For a 234GB model sharded across 6
A100-80GB GPUs (~39GB each), this left no room for the copy.

Now snapshot stores tensors on CPU and restore() moves them back
to each parameter's current device.

2026-03-13 17:13:50 -04:00

..

analysis

Add files via upload

2026-03-08 12:07:56 -07:00

evaluation

Add files via upload

2026-03-08 12:07:56 -07:00

models

Save model snapshot to CPU to avoid OOM on multi-GPU setups

2026-03-13 17:13:50 -04:00

reporting

Add files via upload

2026-03-04 12:38:18 -08:00

strategies

Add files via upload

2026-03-04 12:38:18 -08:00

__init__.py

Add remote SSH execution support for GPU nodes

2026-03-11 15:51:16 -04:00

__main__.py

Add __main__.py and fix remote pip install command

2026-03-12 12:56:03 -04:00

abliterate.py

Revert "Add data parallel support for PROBE stage"

2026-03-13 16:54:31 -04:00

adaptive_defaults.py

Add files via upload

2026-03-07 17:54:38 -08:00

architecture_profiles.py

Add files via upload

2026-03-07 17:54:38 -08:00

bayesian_optimizer.py

Add files via upload

2026-03-08 12:07:56 -07:00

cli.py

Revert "Add data parallel support for PROBE stage"

2026-03-13 16:54:31 -04:00

community.py

Add files via upload

2026-03-04 12:38:18 -08:00

config.py

Add multi-GPU support with --gpus flag

2026-03-12 12:35:29 -04:00

device.py

Add files via upload

2026-03-07 17:53:42 -08:00

informed_pipeline.py

Add files via upload

2026-03-08 12:07:56 -07:00

interactive.py

Add files via upload

2026-03-07 17:54:38 -08:00

local_ui.py

Add files via upload

2026-03-05 10:03:46 -08:00

lora_ablation.py

Add files via upload

2026-03-04 12:38:18 -08:00

mlx_backend.py

Add files via upload

2026-03-07 17:53:42 -08:00

presets.py

Add files via upload

2026-03-04 12:38:18 -08:00

prompts.py

Add files via upload

2026-03-04 12:38:18 -08:00

py.typed

Add files via upload

2026-03-04 12:38:18 -08:00

remote.py

Revert "Add data parallel support for PROBE stage"

2026-03-13 16:54:31 -04:00

reproducibility.py

Add files via upload

2026-03-07 17:53:42 -08:00

runner.py

Add files via upload

2026-03-04 12:38:18 -08:00

study_presets.py

Add files via upload

2026-03-04 12:38:18 -08:00

sweep.py

Add files via upload

2026-03-04 12:38:18 -08:00

telemetry.py

Add files via upload

2026-03-08 13:02:53 -07:00

tourney.py

Add files via upload

2026-03-08 13:02:53 -07:00