Alibaba lightweight in-process vector database
Go to file
rayx ec8a78ee08
refactor(diskann): decouple from libaio via dlopen (#532)
Co-authored-by: Zefeng Yin <yinzefeng.yzf@alibaba-inc.com>
2026-07-16 17:58:25 +08:00
.github refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
cmake fix: resolve compiler warnings and enable -Werror across all CI platforms (#460) 2026-06-05 14:51:37 +08:00
examples refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
python refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
scripts feat: Implement standard tokenizer based on UAX29 (#547) 2026-07-09 10:01:56 +08:00
src refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
tests refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
thirdparty fix: accept Xcode 26.5's renamed libtool version string in iOS Arrow build (#581) 2026-07-10 14:35:31 +08:00
tools refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
.clang-format Initial commit 2025-12-30 11:02:17 +08:00
.clang-tidy chore: enable targeted bugprone clang-tidy checks (#500) 2026-07-08 10:14:42 +08:00
.gitattributes feat: add fts support (#408) 2026-06-01 15:02:54 +08:00
.gitignore rotate: add an optional random rotation feature in INT8/INT4 quantization method (#483) 2026-06-26 19:16:19 +08:00
.gitmodules feat(fts): add stemmer token filter based on Snowball 3.1.1 (#513) 2026-07-07 14:14:13 +08:00
.pre-commit-config.yaml chore: enable the conventional-pre-commit run sucess and update to latest version (#111) 2026-02-25 18:03:20 +08:00
CMakeLists.txt refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00
CODE_OF_CONDUCT.md Initial commit 2025-12-30 11:02:17 +08:00
CONTRIBUTING.md docs(python): declare and enforce 64-bit-only Python support (#576) 2026-07-13 11:54:10 +08:00
LICENSE Initial commit 2025-12-30 11:02:17 +08:00
NOTICE feat: Implement standard tokenizer based on UAX29 (#547) 2026-07-09 10:01:56 +08:00
README.md docs: clarify multi-query wording (#590) 2026-07-14 09:38:02 +08:00
README_CN.md docs: clarify multi-query wording (#590) 2026-07-14 09:38:02 +08:00
pyproject.toml refactor(diskann): decouple from libaio via dlopen (#532) 2026-07-16 17:58:25 +08:00

README.md

English | 中文

zvec logo

Code Coverage Main License PyPI Release Python Versions npm Release

alibaba%2Fzvec | Trendshift

🚀 Quickstart | 🏠 Home | 📚 Docs | 📊 Benchmarks | 🔎 DeepWiki | 🎮 Discord | 🐦 X (Twitter)

Zvec is an open-source, in-process vector database — lightweight, lightning-fast, and designed to embed directly into applications. Battle-tested within Alibaba Group, it delivers production-grade, low-latency and scalable similarity search with minimal setup.

[!Important] 🚀 v0.5.0 (June 12, 2026)

  • Full-Text Search (FTS): Native full-text search — attach an FTS index to any string field and query it with natural-language or structured expressions, no external search engine required.
  • Hybrid Retrieval: Combine full-text, dense-vector, and sparse-vector retrieval in a single query call, with scalar filtering and reranking.
  • DiskANN Index: New on-disk index that keeps the bulk of the index on disk, drastically cutting memory usage for large-scale datasets.
  • Ecosystem & Platforms: New official Go / Rust SDKs, the Zvec Studio visual tool, and RISC-V support.

👉 Read the Release Notes | View Roadmap 📍

💫 Features

  • Blazing Fast: Searches billions of vectors in milliseconds.
  • Simple, Just Works: Install and start searching in seconds. Pure local, no servers, no config, no fuss.
  • Dense + Sparse Vectors: Support dense and sparse embeddings, multi-vector queries, and a rich selection of vector index types that scale from memory to disk.
  • Full-Text Search (FTS): Native keyword-based full-text search — query string fields with natural-language or structured expressions.
  • Hybrid Search: Fuse vector similarity, full-text search, and structured filters in a single query for precise results.
  • Durable Storage: Write-ahead logging (WAL) guarantees persistence — data is never lost, even on process crash or power failure.
  • Concurrent Access: Multiple processes can read the same collection simultaneously; writes are single-process exclusive.
  • Runs Anywhere: As an in-process library, Zvec runs wherever your code runs — notebooks, servers, CLI tools, or even edge devices.

📦 Installation

Zvec offers official SDKs across multiple languages:

  • Python: pip install zvec (requires 64-bit Python 3.103.14)
  • Node.js: npm install @zvec/zvec
  • Go: High-performance Go bindings.
  • Rust: High-performance Rust bindings.
  • Dart/Flutter: flutter pub add zvec

Prefer a visual tool? Try Zvec Studio to browse data and debug queries — no code required.

Supported Platforms

  • Linux (x86_64, ARM64)
  • macOS (ARM64)
  • Windows (x86_64)

🛠️ Building from Source

If you prefer to build Zvec from source, please check the Building from Source guide.

One-Minute Example

import zvec

# Define collection schema
schema = zvec.CollectionSchema(
    name="example",
    vectors=zvec.VectorSchema("embedding", zvec.DataType.VECTOR_FP32, 4),
)

# Create collection
collection = zvec.create_and_open(path="./zvec_example", schema=schema)

# Insert documents
collection.insert([
    zvec.Doc(id="doc_1", vectors={"embedding": [0.1, 0.2, 0.3, 0.4]}),
    zvec.Doc(id="doc_2", vectors={"embedding": [0.2, 0.3, 0.4, 0.1]}),
])

# Search by vector similarity
results = collection.query(
    zvec.Query(field_name="embedding", vector=[0.4, 0.3, 0.3, 0.1]),
    topk=10
)

# Results: list of {'id': str, 'score': float, ...}, sorted by relevance
print(results)

📈 Performance at Scale

Zvec delivers exceptional speed and efficiency, making it ideal for demanding production workloads.

Zvec Performance Benchmarks

For detailed benchmark methodology, configurations, and complete results, please see our Benchmarks documentation.

🤝 Join Our Community

💬 DingTalk 📱 WeChat 🎮 Discord X (Twitter)
DingTalk QR Code WeChat QR Code Discord X (formerly Twitter) Follow
Scan to join Scan to join Click to join Click to follow

❤️ Contributing

We welcome and appreciate contributions from the community! Whether you're fixing a bug, adding a feature, or improving documentation, your help makes Zvec better for everyone.

Check out our Contributing Guide to get started!