Accumulate tokens in generate mode #2674

Job	Run time
test-quantization-mps-macos / macos-job	47s
test-gguf-mps-macos / macos-job	45s
test-readme-mps-macos / macos-job	49s
test-advanced-mps-macos / macos-job	47s
test-evaluation-mps-macos / macos-job	49s
test-multimodal-mps-macos / macos-job	49s
test-native-mps-macos / macos-job	53s
	5m 39s

Provide feedback