xiaoxue_admin
/
memory-os
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
memory-os/scripts
History
ClaudioDrews 58027b95e6 feat: add wiki watcher cron to setup.sh (hourly ingestion) 
- setup.sh Phase 7b: install cron job for wiki_continuous_ingest.py
- watcher script: fallback to Docker .env for REDIS_PASSWORD in cron context
- Cron runs every hour with idempotent marker check
 		2026-06-07 13:23:20 -03:00
..
README.md Initial commit: Memory OS — 6-layer memory architecture for Hermes Agent 2026-05-31 16:50:37 -03:00
backfill_decay_metadata.py fix: normalize vault path case and permissions, remove DS-specific key references 2026-06-07 12:59:04 -03:00
bulk_wiki_ingest.py fix: normalize vault path case and permissions, remove DS-specific key references 2026-06-07 12:59:04 -03:00
collapse_eval.py feat: collapse v2 — attenuate Hebbian boost by query-local salience (#24) 2026-06-07 09:48:00 -03:00
context_enhancer.py fix: resolve all 8 Phase 3 config/path issues 2026-06-03 11:44:22 -03:00
decay_scanner.py docs: rewrite installation guide with real scripts and idempotent modifications (fixes #11) 2026-06-03 09:29:19 -03:00
dlq_manager.py fix: resolve 5 easy Phase 4 performance/resilience issues 2026-06-03 11:53:18 -03:00
pre_validator.py docs: rewrite installation guide with real scripts and idempotent modifications (fixes #11) 2026-06-03 09:29:19 -03:00
reflection_trigger.py docs: rewrite installation guide with real scripts and idempotent modifications (fixes #11) 2026-06-03 09:29:19 -03:00
semantic_dedup.py fix: semantic_dedup.py — adicionar using='dense' ao QueryRequest 2026-06-03 15:59:28 -03:00
test_ingestion.py v0.2.0 — automated install, community infra, 20+ audit fixes 2026-06-05 01:51:24 -03:00
verify_soul_config.py feat: add verify_soul_config.py — check SOUL.md for Memory OS additions (fixes #19) 2026-06-07 08:25:52 -03:00
wiki_continuous_ingest.py feat: add wiki watcher cron to setup.sh (hourly ingestion) 2026-06-07 13:23:20 -03:00

README.md

Memory OS — Scripts

Standalone Python scripts that maintain the Qdrant vector database and wiki pipeline.

Qdrant Maintenance

Script What it does Run
decay_scanner.py Archives low-importance, aged AI content based on half-life decay Weekly cron
backfill_decay_metadata.py Populates missing importance_score, last_accessed_at, confidence_score in Qdrant points Run once before enabling decay scanner
semantic_dedup.py Merges near-duplicate points (cosine >0.92) Monthly cron

Context Injection

Script What it does Used by
context_enhancer.py Embedding pipeline: query → embed → search Qdrant (4-level fallback). Also provides BM25 sparse embedding via FastEmbed. Icarus pre_llm_call hook

Wiki Pipeline

Script What it does Run
wiki_continuous_ingest.py SHA-256 diff detection: finds new/modified wiki files, enqueues ARQ jobs in Redis Hourly cron
bulk_wiki_ingest.py One-shot bulk ingestion of all wiki files into Qdrant After initial setup or collection rebuild

Quality Control

Script What it does Run
pre_validator.py Pre-flight validation of wiki documents: YAML frontmatter, required fields, link targets Before ingestion
reflection_trigger.py Idle detection for ARQ worker — enqueues micro-reflection when queue is empty and within hourly budget Every 5min cron

Monitoring

Script What it does Run
dlq_manager.py Dead letter queue monitoring and reporting Every 6h cron

Environment variables

All scripts read configuration from environment variables. See .env.example in the project root for the full reference.

Key variables:

  • OPENROUTER_API_KEY — embeddings (required)
  • WIKI_PATH — wiki root directory (default: ~/vault/wiki)
  • COLLECTION_NAME — Qdrant collection (default: knowledge_base)
  • EMBEDDING_DIMS — vector dimensions (default: 4096)
  • REDIS_PASSWORD — Redis auth (required for wiki ingest)
  • QDRANT_URL — Qdrant endpoint (default: http://localhost:6333)