monkeypatch.attention.flash_attn_4
monkeypatch.attention.flash_attn_4
Transparently upgrade FA2 to FA4 when available on SM90+ hardware.
Functions
| Name | Description |
|---|---|
| patch_flash_attn_4 | Patch _lazy_imports to redirect FA2 imports to FA4 if available on supported hardware. |
patch_flash_attn_4
monkeypatch.attention.flash_attn_4.patch_flash_attn_4(model_config=None)Patch _lazy_imports to redirect FA2 imports to FA4 if available on supported hardware.