Releases: lucidrains/gateloop-transformer
Releases · lucidrains/gateloop-transformer
0.1.1
patch
0.1.0
one last tweak to simple gateloop layer
0.0.26
last tweak to repo
0.0.25
dog-food jax2torch for using fused associative scan, for the simplifi…
0.0.24
a simplified gateloop for personal use in other projects
0.0.23
another researcher shared with me that complex valued states does not…
0.0.22
add option for sub-ln in case it is important
0.0.21
add post layernorm option, what they used in the paper apparently
0.0.20
actually setup state transition ablation correctly for gateloop
0.0.19
add swish gating to MHA version to be fair