Skip to content

Add deepseek amd ci #27056

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Add deepseek amd ci #27056

wants to merge 4 commits into from
+52 −7

Conversation

@zhewenl
Copy link
Collaborator

@zhewenl zhewenl commented Oct 16, 2025 •
edited by github-actions bot
Loading

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

@mergify mergify bot added ci/build deepseek Related to DeepSeek models rocm Related to AMD ROCm labels Oct 16, 2025
@zhewenl zhewenl force-pushed the add-deepseek-amd-ci branch 2 times, most recently from 5d56857 to c7eee2b Compare October 22, 2025 00:25
zhewenl
zhewenl commented Oct 22, 2025
View reviewed changes
.buildkite/lm-eval-harness/configs/DeepSeek-R1.yaml
metrics:
- name: "exact_match,custom-extract"
value: 0.80
limit: 2 # will run on 250 * 14 subjects = 3500 samples
Copy link
Collaborator Author

@zhewenl zhewenl Oct 22, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

only for faster testing, will update

@zhewenl zhewenl mentioned this pull request Oct 22, 2025
Merged
5 tasks
@zhewenl
support deepseek
038b2b3 
Signed-off-by: zhewenli <[email protected]>
@zhewenl
update naming
4e00504 
Signed-off-by: zhewenli <[email protected]>
@zhewenl zhewenl force-pushed the add-deepseek-amd-ci branch from 7920201 to 4e00504 Compare November 4, 2025 17:51
@zhewenl
pick up changes
5546cc0 
Signed-off-by: zhewenli <[email protected]>
@zhewenl
update
5cccd64 
Signed-off-by: zhewenli <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mgoin mgoin Awaiting requested review from mgoin mgoin will be requested when the pull request is marked ready for review mgoin is a code owner

@simon-mo simon-mo Awaiting requested review from simon-mo simon-mo will be requested when the pull request is marked ready for review simon-mo is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

ci/build deepseek Related to DeepSeek models rocm Related to AMD ROCm

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@zhewenl