monkeypatch.xformers_

monkeypatch.xformers_

Fused MLP layer for incrementally improved training efficiency

Classes

Name Description
FusedMLP Fused MLP layer for incrementally improved training efficiency

FusedMLP

monkeypatch.xformers_.FusedMLP(config, gate_proj, up_proj, down_proj)

Fused MLP layer for incrementally improved training efficiency