Replies: 1 comment 1 reply
-
|
Currently it is not released to the public considering how large the codebase is. For now you will need to use either our Dynamic GGUFs or uploaded safetensors on HF |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have reviewed the codes, but cannot find code about the dynamic quantization tool. The tool are open sourced? It is released here or somewhere?
Beta Was this translation helpful? Give feedback.
All reactions