0.3.6

Full Changelog: 0.3.5...0.3.6

0.3.5

Full Changelog: 0.3.4...0.3.5

0.3.4

fix regression and some dimension conditional

0.3.3

What's Changed

• chore: update flash attention config by @eegli in #18

New Contributors

• @eegli made their first contribution in #18

Full Changelog: 0.3.2...0.3.3

0.3.2

Full Changelog: 0.3.1...0.3.2

0.3.1

Full Changelog: 0.3.0...0.3.1

0.3.0

Full Changelog: 0.2.1...0.3.0

0.2.1

make sure it supports greater than 2 hierarchies

0.2.0

move closer to what the paper did, with local and global token embedd…

0.1.7

switch to rotary embeddings, as they did in the paper