Skip to content

Commit 34dc469

Browse files
Fixed typo (#1458)
1 parent afb4ad0 commit 34dc469

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

src/cpp/src/continuous_batching_impl.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -195,7 +195,7 @@ void ContinuousBatchingPipeline::ContinuousBatchingImpl::step() {
195195
step_count++;
196196
#endif
197197

198-
// process generation_config.echo parameetr
198+
// process generation_config.echo parameter
199199
_fill_prompt_log_probs(m_requests, logits);
200200

201201
SamplerOutput sampler_output;

src/cpp/src/lm_encoding.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,7 @@ std::pair<EncodedResults, std::optional<int64_t>> get_lm_encoded_results(
119119

120120
auto logits = m_llm.get_tensor("logits");
121121

122-
// since we have applied `Slice` operationto last MatMul, model output sequence lenght is 1
122+
// since we have applied `Slice` operation to last MatMul, model output sequence lenght is 1
123123
// so, we need to update sequence groups to think that they already have processed all prompt tokens except last ones
124124
// and schedule only `output_sequence_len` ones
125125
int64_t output_sequence_len = logits.get_shape().at(1);

0 commit comments

Comments
 (0)