See state-space/mamba and paper
Mama uses a selective SSM scan.
State-space duality (SSD): SSM + attentions layers (SMA, or structured masked attention)
See state-space/mamba and paper
Mama uses a selective SSM scan.
State-space duality (SSD): SSM + attentions layers (SMA, or structured masked attention)