Skip to content

Commit 52e2b9d

Browse files
authored
Update activations.h
Comment
1 parent 9f801d3 commit 52e2b9d

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

onnxruntime/contrib_ops/cpu/activations.h

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -90,6 +90,7 @@ class QuickGelu : public OpKernel {
9090

9191
MlasComputeLogistic(p_output, p_output, onnxruntime::narrow<size_t>(count));
9292
} else {
93+
// SILU activation - this needs no `alpha_` scaling as `alpha_` will be 1.0f
9394
MlasComputeLogistic(p_input, p_output, onnxruntime::narrow<size_t>(count));
9495
}
9596

0 commit comments

Comments
 (0)