Commit Graph
8 Commits
Author SHA1 Message Date
Joseph Magly c74538a2be test: harden checkpoint transaction reliability 2026-08-16 00:28:15 -04:00
Joseph Magly c642cb3297 test: harden GPU memory utilization contract 2026-08-15 02:47:28 -04:00
Joseph Magly 18c910b529 test: validate refusal token limits 2026-08-14 20:03:46 -04:00
Joseph Magly 66c47249df ci: add strict test evidence gates 2026-08-14 11:44:12 -04:00
Joseph Magly bc891794db test: cover offloaded state materialization (#27) 2026-08-14 10:26:56 -04:00
Aaron Meese e1a0fe59f0 fix: REBIRTH save crash for CPU-offloaded models
Replace the manual safetensors/dat file materialization in
_gather_state_dict with accelerate's get_state_dict_offloaded_model().
The old code only handled disk-offloaded weights but failed for the 398
CPU-offloaded meta tensors managed by accelerate's AlignDevicesHook.

Pre-move all GPU tensors to CPU before materialization to prevent CUDA
OOM when align_module_device restores non-hooked params to CUDA during
its __exit__ cleanup.

Update test to verify the safety net catches unmaterialized meta tensors
after the accelerate path (the old test checked for a missing offload
directory, which this codepath no longer uses).
2026-08-14 10:22:48 -04:00
Joseph Magly 548092d5ca ci: establish green validation baseline (#59) 2026-08-14 09:55:49 -04:00
pliny 66ea4a6f86 Add files via upload 2026-03-05 00:50:44 -08:00