monkeypatch.gradient_checkpointing.offload_cpu

monkeypatch.gradient_checkpointing.offload_cpu

CPU offloaded checkpointing

Classes

Name	Description
CPU_Offloaded_Gradient_Checkpointer	Saves VRAM by smartly offloading to RAM.

CPU_Offloaded_Gradient_Checkpointer

monkeypatch.gradient_checkpointing.offload_cpu.CPU_Offloaded_Gradient_Checkpointer(
)

Saves VRAM by smartly offloading to RAM. Tiny hit to performance, since we mask the movement via non blocking calls.