Skip to content

Commit 9af9286

Browse files
hheydarycopybara-github
authored andcommitted
Docstring update to ensure correct conversion flags are used.
PiperOrigin-RevId: 806014125
1 parent 43123f6 commit 9af9286

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

ai_edge_torch/generative/examples/cpp/text_generator_main.cc

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,12 @@ limitations under the License.
5353
// --start_token="<bos>" \
5454
// --stop_token="<eos>" \
5555
// --num_threads=4
56+
//
57+
//
58+
// NOTES: This example assumes *internal attenion mask* and *untransposed KV*
59+
// in the model. This requires setting `--mask_as_input=False` and
60+
// `--transpose_kv_cache=False` in the conversion.
61+
//
5662

5763
ABSL_FLAG(std::string, tflite_model, "",
5864
"Two-signature tflite model prepared for text generation using ODML "

0 commit comments

Comments
 (0)