Skip to content

Commit 1a38cfa

Browse files
committed
Added Colab notebooks to convert, quantize, and inference PaliGemma 2 with Transformers.js using its ONNX weights.
1 parent bd7763a commit 1a38cfa

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

PaliGemma/README.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,9 @@ This folder is organized into several categories, each focusing on a speicific a
1717
| [[PaliGemma_1]Zero_shot_object_detection_in_videos.ipynb]([PaliGemma_1]Zero_shot_object_detection_in_videos.ipynb) | Zero-shot Object Detection in videos using PaliGemma. |
1818
| [[PaliGemma_2]Keras_Quickstart.ipynb]([PaliGemma_2]Keras_Quickstart.ipynb) | PaliGemma 2 3B DOCCI model quickstart tutorial with Keras |
1919
| [[PaliGemma_2]Using_with_Transformersjs.ipynb]([PaliGemma_2]Using_with_Transformersjs.ipynb) | Run PaliGemma 2 with Transformers.js. |
20+
| [[PaliGemma_2]Convert_PaliGemma2_to_ONNX.ipynb]([PaliGemma_2]Convert_PaliGemma2_to_ONNX.ipynb) | Convert and quantize PaliGemma 2 to ONNX format, making it compatible for inferencing with Transformers.js. |
21+
| [[PaliGemma_2]Inference_PaliGemma2_with_Transformers_js.ipynb]([PaliGemma_2]Inference_PaliGemma2_with_Transformers_js.ipynb) | Inference PaliGemma 2 with Transformers.js for tasks like image captioning, zero-shot object detection, OCR, and visual Q&A. |
22+
2023
## Finetuning
2124
| Notebook Name | Description |
2225
| :----------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
@@ -25,6 +28,4 @@ This folder is organized into several categories, each focusing on a speicific a
2528
| [[PaliGemma_1]Finetune_with_image_description.ipynb]([PaliGemma_1]Finetune_with_image_description.ipynb) | Finetune PaliGemma for image description using [JAX](https://github.com/google/jax). |
2629
| [[PaliGemma_1]Finetune_with_object_detection.ipynb]([PaliGemma_1]Finetune_with_object_detection.ipynb) | Fine-tune PaliGemma for object detection on a fashion dataset using [JAX](https://github.com/google/jax). |
2730
| [[PaliGemma_2]Finetune_with_JAX.ipynb]([PaliGemma_2]Finetune_with_JAX.ipynb) | Finetune PaliGemma 2 with JAX. |
28-
| [[PaliGemma_2]Finetune_with_Keras.ipynb]([PaliGemma_2]Finetune_with_Keras.ipynb) | Finetune PaliGemma 2 with Keras. |
29-
| [[PaliGemma_2]Convert_PaliGemma2_to_ONNX.ipynb]([PaliGemma_2]Convert_PaliGemma2_to_ONNX.ipynb) | Convert and quantize PaliGemma 2 to ONNX format, making it compatible for inferencing with Transformers.js. |
30-
| [[PaliGemma_2]Inference_PaliGemma2_with_Transformers_js.ipynb]([PaliGemma_2]Inference_PaliGemma2_with_Transformers_js.ipynb) | Inference PaliGemma 2 with Transformers.js for tasks like image captioning, zero-shot object detection, OCR, and visual Q&A. |
31+
| [[PaliGemma_2]Finetune_with_Keras.ipynb]([PaliGemma_2]Finetune_with_Keras.ipynb) | Finetune PaliGemma 2 with Keras. |

0 commit comments

Comments
 (0)