[WIP] ANNs for clustering at training time #1938
Open
HowardHuang1 wants to merge 12 commits into
Open
Conversation
…es to find inflection point
… applied to accelerate extend()
aamijar
added
non-breaking
Contributor
|
/ok to test d26e916 |
…nment for clarity
…sed by upstream changes. Add 2 helper functions to recover use_ann_for_extend flag after serialize/deserialize
…rrors Extend_NearestCentroidLookup_Speedup for clarity
…up_Speedup and BM_IVFPQ_Extend_NearestCentroidLookup_Speedup. Also rename use_ann_for_fit to use_ann_for_build_fit to clear up confusion because ANN for nearest cluster assignment can occur in 2 places within build(): (1) in fit and (2) post-fit
…stfit boolean and test cases. Since extend and postfit both use ann on fixed centroids, we factored out common code. Renamed functions in kmeans_balanced.cuh for clarity: assign_nearest_centroid_cagra now more accurately mirrors assign_nearest_centroid_cagra_with_index_reuse.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.