Commit Graph
26 Commits
Author SHA1 Message Date
Qinren Zhou ae345ad070 fix: recovery from crash during optimization (#246) 2026-03-24 10:53:16 +08:00
rayx 31aaa2febb feat: add euclidean one2many (#188)
* add euclidean one2many implementation
2026-03-23 20:20:48 +08:00
egolearner e5ba11b6fe feat: add hnsw-rabitq support (#69)
* feat: add hnsw-rabitq

* undefine transform

* support config rotator type

* support sample_count

* fix ut

* refactor: update interface

* refactor: update interface

* update rabitq index params

* fix interface update

* fix searcher test

* fix streamer test

* streamer support bf and add more ut

* rm env check

* add collection ut

* add schema check

* add rabitq query param binding

* add integration test

* fix local_builder

* cleanup dist calculator

* add RaBitQ-Library submodule

* cleanup rabitq converter/reformer

* add files

* disable build on mac

* disable Feature_Optimize_HNSW_RABITQ

* disable python/tests/test_collection_hnsw_rabitq.py:13

* check avx2/avx512

* fix refine

* fix mac ci

* add dimension check

* fix mac ci

* fix ci

* add missing lib

* fix centroids selection for Cosine/InnerProduct

* rename hnsw-rabitq to hnsw_rabitq

* address comments

* fix compile

* fix rabitqlib name

* fix mac compile

* check avx2/avx512 support

* runtime check again compile-time

* check AUTO_DETECT_ARCH

* rm debug log

* fix

* rabitq use avx2 by default

* add missing file

* fix search_bf/group_by dist

* address comments

* fix typo

* address comments

* rabitq support disable id_map

* address comments
2026-03-19 17:21:42 +08:00
ZeFeng Yin 432de52c5f [enhance] buffer storage (#83) 2026-03-19 15:24:46 +08:00
rayx d4ffbf06af fix: fix metric batch (#245) 2026-03-19 13:39:10 +08:00
luoxiaojian 840bcdad26 feat: Introduce turbo. (#243) 2026-03-18 20:43:18 +08:00
Qinren Zhou 3c1241f7c6 feat: enlarge indice size limit for sparse vectors (#229) 2026-03-16 17:12:24 +08:00
luoxiaojian 79387c237f feat: enable icelake and l2 batch distance for int8 quantization. (#213) 2026-03-13 17:26:22 +08:00
feihongxu0824 24d877da5e fix: Replace VLAs with std::vector for MSVC compatibility and stack safety (#190) 2026-03-03 10:07:21 +08:00
longwayandZeFeng Yin 4e420311df chore(flat): replace std::map with std::unordered_map for key_id_mapping_ (#153)
Reduces key lookup in get_id() from O(log N) to O(1) average, and index
load time from O(N log N) to O(N). Also lowers per-entry memory usage by
eliminating the three tree-node pointers (parent/left/right).

Co-authored-by: ZeFeng Yin <yinzefeng.yzf@alibaba-inc.com>
2026-02-28 13:10:38 +08:00
ZeFeng Yin ba6acbf48f fix: ivf optimize (#169) 2026-02-27 17:35:52 +08:00
lichen2015andyinzefeng.yzf e7ad7cc31e fix: combined indexer should use key instead of index (#87)
Co-authored-by: yinzefeng.yzf <yinzefeng.yzf@alibaba-inc.com>
2026-02-12 10:38:05 +08:00
Jalin Wang 78f08bd0cc feat: auto scalable segment meta section of mmap files (#67)
The underly core module only support a fixed-size segment due to the index file format where the section of segments meta limit the max num of data segments. This commit makes the meta section dynamically allocated and organized in a link-table manner to support much more segments.


* revert local_builder's meta cap setting

* feat: auto scalable segment meta section of mmap files

* Revert "feat: auto scalable segment meta section of mmap files"

This reverts commit 82c11e451544b912b901be33fae79e964a487b1f.

* v2: don't change to absolute offset
2026-02-06 14:58:56 +08:00
richyreachyandfeihongxu0824 a20d484e9e refactor(core): unify search invoke (#15)
Co-authored-by: feihongxu0824 <xufeihong.xfh@alibaba-inc.com>
2026-02-03 12:40:23 +08:00
姚军 ea9d957893 fix: some typos in hnsw index (#50) 2026-02-03 10:41:21 +08:00
iaojnh 8c1819ca26 change hnsw single dist to batch dist (#40) 2026-01-29 10:18:57 +08:00
egolearner 66f137efee fix: fix MemoryReadStorage read by MemoryBlock (#38) 2026-01-27 14:11:28 +08:00
feihongxu0824 0ebf5621a6 feat: support core cpp sdk (#30)
* support core cpp sdk

* fix

* fix

* fix

* fix cr
2026-01-26 20:01:44 +08:00
Jalin Wang 0af6a62c31 fix: flat support more segments (#32)
* fix

* fix compilation
2026-01-26 16:22:37 +08:00
Jalin Wang bc90952a01 refactor: flat param string cleanup (#28)
* refactor: flat param string cleanup

* fix
2026-01-26 14:49:35 +08:00
richyreachy 614f955c5f fix: remove empty files (#33) 2026-01-26 10:08:51 +08:00
feihongxu0824andzhouqinren.zqr e957442355 feat: refact cpp sdk (#27)
* refact cpp sdk

---------

Co-authored-by: zhouqinren.zqr <zhouqinren.zqr@alibaba-inc.com>
2026-01-21 20:05:42 +08:00
iaojnh e17c4a88bc refactor: clarify HNSW 'scaling_factor' as 'm' instead of 50 (#17) 2026-01-12 20:05:29 +08:00
egolearner 89f9c378ac fix: fix default m (#20)
* fix: fix default m

* fix doc str

* fix ut
2026-01-12 10:22:58 +08:00
Jalin Wang 84b5f03f5e refactor: clarify HNSW 'm' as max neighbors of upper layer (#12)
* refactor: clarify HNSW 'm' as max neighbors of upper layer

- Distinguish l0/upper_max_neighbor_cnt
- Define l0_max_neighbor_cnt as m * l0_multiplier.

* fix ut
2026-01-08 16:31:14 +08:00
sanyi 6524fabd80 Initial commit 2025-12-30 11:02:17 +08:00