Skip to content

Rakri/multifilter cleaned #635

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 83 commits into
base: main
Choose a base branch
from
Open

Rakri/multifilter cleaned #635

wants to merge 83 commits into from

Conversation

@rakri
Copy link
Contributor

@rakri rakri commented Mar 18, 2025

  • Does this PR have a descriptive title that could go in our release notes?
  • Does this PR add any new dependencies?
  • Does this PR modify any existing APIs?
    • Is the change to the API backwards compatible?
  • Should this result in any changes to our documentation, either updating existing docs or adding new ones?

Reference Issues/PRs

What does this implement/fix? Briefly explain your changes.

Any other comments?

rakri and others added 30 commits February 11, 2024 16:42
added space inefficient code
654ceb0
added multifilter gt
1c46db0
minor bug fix for large base files
6776ee1
setting up AND queries
23d4d27
write code for penalty method
5d6134a
commented warning for fewer than K results
e5f449e
minor edits for penalty method
7406bbd
resolved conflict
8309924
small bug fix in penalty calculation
6e7d4fa
small change to final post-processing
3be62b5
Minor changes and clang-format
13e7a2d
Add roaring bitmaps and sample snippet to search_memory_index.cpp
f760ebf
Add roaring bitmaps to graph traversal and bruteforce plan
6ac465a
gt now prints sme stats
2d8ca0c
minor clang-format
768457f
Revert graph traversal to regular set intersection
a07d9c2
added a tester util for bitmap perf
cdd4f9e
added id_list and started cluster store
62ca20d
added cluster_store.cpp
8da6899
setup ivf clustering in index class for build and load. yet to handle…
525953e 
… search code
minor bug fix
cfe12d1
minor bug fix in indexing
11f39d4
minor fix
2d9d113
minor fix
e9f3b89
Add clustering to search path
fda3b8d
Merge branch 'rakri/multifilter_with_query_planning' of https://githu…
22ba983 
…b.com/microsoft/DiskANN into rakri/multifilter_with_query_planning
fixed some bugs: TODO: add shared pointers and destructor for id_list
341f1c3
Add query stats
f450421
changing roaring from c to c++
9982540
Add avg time to perform each step of clustering
f759bc3
ravishankar and others added 30 commits May 10, 2024 10:25
minor changes
d9ca810
clang-format
8591906
added back build index
caffb4f
nuanced prints in search_memory_index
6e37cdd
Remove cout
ff5c3c2
Add search path tracing for query 1 and generalize filtered diskann b…
e2cf3a9 
…uild
minor fix
4d306fb
Add penalty distance to iterate
2114cf4
minor commit conflict
d1b3fab
Make query stats print for all graph-routed queries
5c0d23d
commented some debug code
5acfb0a
rebased
8776842
Add some improvements for QPS gain
c2786b8
Add some bugfixes
a183e26
minor changes
2a2c874
filtered GT now takes AND of ORs
81d63a3
minor changes
34c9ce6
minor styling fix
ede9ea1
added some commented code to print more useful debugging txt
dea551a
added flag to decide start point
9907d53
minor assert removed in GT
1a89fc0
made some changes for num local start pts
ca2fb3b
first commit to generalize to AND of ORs
a2e6a0a
made changes to and of or for iterate, etc.
d546f46
minor fixes
dc7f559
added post-processing module
d4f609b
added minor instrumentation
3e45bc7
minor instr. bug
55b605f
cleaned up and rempved clustering
a8bfb30
minor changes
b06049d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@rakri @suri-kumkaran