zvec/tests/core/algorithm/hnsw
Zihao Wang d29bffca39
fix(quantizer): use rounded int8 values for SQ8 metadata to fix recall drop (#329)
fixes #328

Problem:
SQ8 metadata (squared_sum, sum) was computed from pre-rounded float
values, causing mismatch with actual stored int8 values. On asymmetric
datasets (e.g. OpenAI 1536D where |x_min| >> x_max), this leads to
severe recall drop.

Solution:
Move std::round before accumulating squared_sum and sum.

Co-authored-by: rayx <rui.xing@alibaba-inc.com>
2026-04-16 10:07:14 +08:00
..
CMakeLists.txt fix(build): replace CMAKE_SOURCE_DIR with PROJECT_ROOT_DIR for subproject builds (#195) 2026-03-04 20:01:52 +08:00
hnsw_builder_test.cc feat: windows support (#216) 2026-03-30 20:47:34 +08:00
hnsw_searcher_test.cpp feat: windows support (#216) 2026-03-30 20:47:34 +08:00
hnsw_streamer_buffer_test.cc feat: windows support (#216) 2026-03-30 20:47:34 +08:00
hnsw_streamer_test.cc fix(quantizer): use rounded int8 values for SQ8 metadata to fix recall drop (#329) 2026-04-16 10:07:14 +08:00