SLS method

[thegodone]

Thanks for making this nice recap of the hart of AI the optimizers!

I have a question regarding the SLS method can you implement something similar to Adam so without the Closure part ?

It would be nice to have a generic method compatible with classical optimizers in pytorch.

Another related question: is it so good like the paper claim ?