Skip to content

[CI] [GHA] Split wheel building job into several parallel ones #3032

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 14 commits into
base: master
Choose a base branch
from
+293 −124
Open

[CI] [GHA] Split wheel building job into several parallel ones #3032

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
57d3e7e
use sccache
akashchi Nov 18, 2025
933df05
use parallel
akashchi Nov 18, 2025
151574f
Revert "use parallel"
akashchi Nov 19, 2025
78500f8
Merge remote-tracking branch 'upstream/master' into ci/gha/speed-up-w…
akashchi Nov 19, 2025
d4ca5db
use ninja
akashchi Nov 19, 2025
81a319c
check sccache stats
akashchi Nov 21, 2025
ca65515
Merge remote-tracking branch 'upstream/master' into ci/gha/speed-up-w…
akashchi Nov 21, 2025
fd3defe
use matrix
akashchi Nov 21, 2025
7fedb35
combine tokenizer and wwb wheel
akashchi Nov 21, 2025
66ce9ac
use 8 core, use the same approach in manylinux
akashchi Nov 21, 2025
4671b36
use approach in win
akashchi Nov 21, 2025
e231ae0
use ninja for building wheels
akashchi Nov 26, 2025
e790d6b
Merge remote-tracking branch 'upstream/master' into ci/gha/speed-up-w…
akashchi Nov 26, 2025
223ce56
Merge branch 'master' into ci/gha/speed-up-wheel-build
akashchi Nov 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 14 additions & 1 deletion .github/workflows/linux.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -172,6 +172,8 @@ jobs:
cmake -DOpenVINODeveloperPackage_DIR=${{ env.OV_INSTALL_DIR }}/developer_package/cmake \
-DENABLE_PYTHON=OFF \
-DCMAKE_BUILD_TYPE=${{ matrix.build-type }} \
-DCMAKE_CXX_COMPILER_LAUNCHER=sccache \
-DCMAKE_C_COMPILER_LAUNCHER=sccache \
-S ${{ env.SRC_DIR }} \
-B ${{ env.BUILD_DIR }}
cmake --build ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --parallel $(nproc) --verbose
Expand All @@ -192,6 +194,8 @@ jobs:
cmake -DOpenVINODeveloperPackage_DIR=${{ env.OV_INSTALL_DIR }}/developer_package/cmake \
-DENABLE_PYTHON=ON \
-DCMAKE_BUILD_TYPE=${{ matrix.build-type }} \
-DCMAKE_CXX_COMPILER_LAUNCHER=sccache \
-DCMAKE_C_COMPILER_LAUNCHER=sccache \
-S ${{ env.SRC_DIR }} \
-B ${{ env.BUILD_DIR }}
echo "Configuring cmake done for python$py_version"
Expand Down Expand Up @@ -291,6 +295,7 @@ jobs:
python -m pip wheel -v --no-deps --wheel-dir ${{ env.WHEELS_DIR }} \
--config-settings='override=wheel.build_tag="${{ github.run_number }}"' \
--config-settings=override=cross.arch="manylinux_2_31_x86_64" \
--config-settings=cmake.args="-DCMAKE_CXX_COMPILER_LAUNCHER=sccache -DCMAKE_C_COMPILER_LAUNCHER=sccache" \
${{ needs.openvino_download.outputs.ov_wheel_source }} \
${{ env.SRC_DIR }}/thirdparty/openvino_tokenizers
working-directory: ${{ env.OV_INSTALL_DIR }}
Expand All @@ -306,6 +311,7 @@ jobs:
python_exec_path=$(python$py_version -c "import sys; print(sys.executable)")
$python_exec_path -m pip wheel -v --no-deps --wheel-dir ${{ env.WHEELS_DIR }} \
--config-settings=override=cross.arch="manylinux_2_31_x86_64" \
--config-settings=cmake.args="-DCMAKE_CXX_COMPILER_LAUNCHER=sccache -DCMAKE_C_COMPILER_LAUNCHER=sccache" \
${{ needs.openvino_download.outputs.ov_wheel_source }} \
${{ env.SRC_DIR }}
done
Expand Down Expand Up @@ -427,7 +433,10 @@ jobs:
if: ${{ 'Release' != matrix.build-type }}
run: |
source ${{ env.OV_INSTALL_DIR }}/setupvars.sh
cmake -DCMAKE_BUILD_TYPE=${{ matrix.build-type }} -S ${{ env.OV_INSTALL_DIR }}/samples/cpp/ -B ${{ env.BUILD_DIR }}
cmake -DCMAKE_BUILD_TYPE=${{ matrix.build-type }} \
-DCMAKE_CXX_COMPILER_LAUNCHER=sccache \
-DCMAKE_C_COMPILER_LAUNCHER=sccache \
-S ${{ env.OV_INSTALL_DIR }}/samples/cpp/ -B ${{ env.BUILD_DIR }}
cmake --build ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --parallel $(nproc)
cmake --install ${{ env.BUILD_DIR }} --config ${{ matrix.build-type }} --component samples_bin --prefix ${{ env.INSTALL_DIR }}

Expand Down Expand Up @@ -486,6 +495,8 @@ jobs:
run: |
source ${{ env.OV_INSTALL_DIR }}/setupvars.sh
cmake -DCMAKE_BUILD_TYPE=${{ matrix.build-type }} \
-DCMAKE_CXX_COMPILER_LAUNCHER=sccache \
-DCMAKE_C_COMPILER_LAUNCHER=sccache \
-DENABLE_JS=ON -DCPACK_GENERATOR=NPM \
-DENABLE_PYTHON=OFF -DENABLE_WHEEL=OFF \
-S ${{ env.SRC_DIR }} -B ${{ env.BUILD_DIR }}
Expand Down Expand Up @@ -915,6 +926,8 @@ jobs:
-DENABLE_XGRAMMAR=OFF \
-BUILD_TOKENIZERS=OFF \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_CXX_COMPILER_LAUNCHER=sccache \
-DCMAKE_C_COMPILER_LAUNCHER=sccache \
-S ${{ env.SRC_DIR}} \
-B ${{ env.BUILD_DIR }}
cmake --build ${{ env.BUILD_DIR}} --config Release --parallel $(nproc) --target py_openvino_genai --verbose
Expand Down
Loading