Skip to content

Conversation

@satabios
Copy link

No description provided.

@ffdm
Copy link
Contributor

ffdm commented Mar 8, 2025

Hey this is pretty cool! I see in your PR title that you mention quantization, but I don't see any mention of quantization in your actual tutorial. Is there something I am missing?

@satabios
Copy link
Author

satabios commented Mar 8, 2025

@ffdm,

Thanks for checking this tutorial.

The sconce package was updated post to the the PR, hence if you rerun the tutorial you would find Quantization also being applied on to the target model.

Please check sconce: https://github.com/satabios/sconce for the latest builds. Hit the star if you like the package.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants