fixes #328 Problem: SQ8 metadata (squared_sum, sum) was computed from pre-rounded float values, causing mismatch with actual stored int8 values. On asymmetric datasets (e.g. OpenAI 1536D where |x_min| >> x_max), this leads to severe recall drop. Solution: Move std::round before accumulating squared_sum and sum. Co-authored-by: rayx <rui.xing@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| algorithm | ||
| framework | ||
| interface | ||
| metric | ||
| quantizer | ||
| utility | ||
| CMakeLists.txt | ||