Skip to content

provider: dedicated provide queue #907

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 18 commits into from
Apr 24, 2025
Merged

provider: dedicated provide queue #907

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
716e1cd
prioritize new provides
guillaumemichel Apr 9, 2025
0a199e0
changelog
guillaumemichel Apr 9, 2025
30c634c
split provide and reprovide queues
guillaumemichel Apr 9, 2025
c3975cc
adjust slice capacity
guillaumemichel Apr 9, 2025
6cb0cff
fix hanging test
guillaumemichel Apr 9, 2025
7a8f29c
fix race condition
guillaumemichel Apr 9, 2025
92e2ba0
instant provides
guillaumemichel Apr 11, 2025
ea97ca3
optimize waitUntilProvideSystemReady ticker
guillaumemichel Apr 15, 2025
cd45ce1
Merge branch 'main' into prioritize-new-provides
guillaumemichel Apr 15, 2025
541cf0e
removing cid deduplication logic
guillaumemichel Apr 15, 2025
47720cb
removed batched provides
guillaumemichel Apr 16, 2025
13ec2a0
remove unused variables
guillaumemichel Apr 16, 2025
d26d20a
Merge branch 'main' into prioritize-new-provides
guillaumemichel Apr 16, 2025
a8e4345
rename maxReprovideBatchSize
guillaumemichel Apr 16, 2025
75ffcd7
ProviderWorkerCount takes an int
guillaumemichel Apr 16, 2025
fc2e7f9
address review
guillaumemichel Apr 22, 2025
6ab2994
deduplicate cids in reprovide
guillaumemichel Apr 23, 2025
196fd34
Merge branch 'main' into prioritize-new-provides
guillaumemichel Apr 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ The following emojis are used to highlight certain changes:
- upgrade to `go-libp2p` [v0.41.1](https://github.com/libp2p/go-libp2p/releases/tag/v0.41.1)
- `bitswap/network`: Add a new `requests_in_flight` metric gauge that measures how many bitswap streams are being written or read at a given time.
- improve speed of data onboarding by batching/bufering provider queue writes [#888](https://github.com/ipfs/boxo/pull/888)
- `provider`: providing queue is now independent from reprovides, speeding up initial provides [#907](https://github.com/ipfs/boxo/pull/907)
- `provider/queue` deduplicates CIDs [#910](https://github.com/ipfs/boxo/pull/910)

### Removed
Expand Down
Loading