From 1d54231fcafe2c5984df8514050816b712ca25c6 Mon Sep 17 00:00:00 2001 From: xiaowei Date: Sat, 30 May 2026 02:08:30 +0800 Subject: [PATCH] =?UTF-8?q?G2:=20Embedding=20=E6=9C=AC=E5=9C=B0=E5=8C=96?= =?UTF-8?q?=20=E2=80=94=20=E9=85=8D=E7=BD=AE=E6=A8=A1=E5=8A=9B=E6=96=B9?= =?UTF-8?q?=E8=88=9F=20API?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - 确认 bge-m3 模型已下载 /home/muc/models/bge-m3/ - ONNX BGE 服务使用 12.7GB RAM,机器撑不住,已停用 - VLLM_ENDPOINT → https://ai.gitee.com/v1/embeddings - 新增 MOLIFANG_API_KEY 环境变量 - deploy/zhiyid.service 同步到 /etc/systemd/system/ - 全链路验证通过: encode 389ms → ANN 40ms → rerank 921ms → MMR 0ms - 本地 vLLM 部署标记为 G2.5(延后,需安装 vllm 依赖) 待办: G2.5 安装 vllm + 部署本地 BGE (port 8000) — 需要下载 torch 等依赖,约 30min --- deploy/zhiyid.service | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/deploy/zhiyid.service b/deploy/zhiyid.service index 355ac7a..869ecdf 100644 --- a/deploy/zhiyid.service +++ b/deploy/zhiyid.service @@ -11,7 +11,8 @@ Environment=PORT=7821 Environment=STORAGE_BACKEND=lancedb Environment=SQLITE_PATH=/var/lib/memoryweave/memoryweave.db Environment=API_KEY=zhiyi-dev-key-2026 -Environment=VLLM_ENDPOINT=http://localhost:8000/v1/embeddings +Environment=VLLM_ENDPOINT=https://ai.gitee.com/v1/embeddings +Environment=MOLIFANG_API_KEY=3TSVVXRFFECE4TISXHGE1VXDAXBIPAP6O1VPJK18 Environment=LLM_ENDPOINT=http://127.0.0.1:3000/v1/chat/completions Environment=LLM_MODEL=qwen/qwen3.5-122b-a10b Environment=LLM_API_KEY=sk-0ExNiLblJvIWBDpkS50fwOBw4MmqLyKdHJK5iQtlw9dOMWBP