0.0.7

add token shift from rwkv

0.0.6

demonstrate on enwik8

0.0.5

fix alibi with flash attention

0.0.4

flash attention

0.0.3

patch embed with dual patchnorm instead of just a simple reduce

0.0.2

use pack and  unpack from einops 0.6

0.0.1

first commit