A to Z Experience Verification #4

New issue

Closed

opened 2026-06-11 14:50:18 +00:00 by fatmaebrahim · 1 comment

fatmaebrahim commented

2026-06-11 14:50:18 +00:00

Member

Tested API Methods

All 60 OpenRPC methods called and verified
Server: info, health, stats
Workspaces: create, list, get, update, delete, stats
Embedding: embed (384-dim vectors)
Index: add, get, delete, count, clear, delete_db
Search: semantic search with reranking, rerank
Vectors: add, get, search, delete
KVS: set, get, list, delete, clear
Cache: stats, clear
Logs: get, clear, stream
Collections: create, list, get, scan, delete
Doctree: scan, pages, page, image, file, export
Convert: markdown conversion
QA: list, search, extract, purge
Ontology: list, get, attach, extract, stats, purge
Memory search: unified search
Corpus: stats, load, load_batch, benchmark

End-to-end scenarios

Knowledge base — add docs, search by topic, verify ranking, rerank
Multi-tenant isolation — 3 tenants with secrets, verify no cross-tenant data leaks
Document updates — add v1, search, update to v2, verify search reflects changes
Embedding + KVS metadata — index products, store metadata in KVS, search + fetch
Full QA pipeline — scan, convert, extract, search, list, purge, verify empty
Ontology lifecycle — load defaults, list, get, attach, extract, stats, purge
Collection pipeline — create, scan, convert, verify
Cache — cold embed, warm embed, clear
Logs — generate operations, verify captured, clear
Workspace model changes — update reranker, disable/enable, update description
Doctree chain — scan, pages, get content, export
Error handling — bad workspace, empty query, missing params, invalid method, duplicates, special chars

Bugs Found

#5 fixed in #9
#6 fixed in #10
#7 fixed in #11

### Tested API Methods - All 60 OpenRPC methods called and verified - Server: info, health, stats - Workspaces: create, list, get, update, delete, stats - Embedding: embed (384-dim vectors) - Index: add, get, delete, count, clear, delete_db - Search: semantic search with reranking, rerank - Vectors: add, get, search, delete - KVS: set, get, list, delete, clear - Cache: stats, clear - Logs: get, clear, stream - Collections: create, list, get, scan, delete - Doctree: scan, pages, page, image, file, export - Convert: markdown conversion - QA: list, search, extract, purge - Ontology: list, get, attach, extract, stats, purge - Memory search: unified search - Corpus: stats, load, load_batch, benchmark ### End-to-end scenarios - Knowledge base — add docs, search by topic, verify ranking, rerank - Multi-tenant isolation — 3 tenants with secrets, verify no cross-tenant data leaks - Document updates — add v1, search, update to v2, verify search reflects changes - Embedding + KVS metadata — index products, store metadata in KVS, search + fetch - Full QA pipeline — scan, convert, extract, search, list, purge, verify empty - Ontology lifecycle — load defaults, list, get, attach, extract, stats, purge - Collection pipeline — create, scan, convert, verify - Cache — cold embed, warm embed, clear - Logs — generate operations, verify captured, clear - Workspace model changes — update reranker, disable/enable, update description - Doctree chain — scan, pages, get content, export - Error handling — bad workspace, empty query, missing params, invalid method, duplicates, special chars ### Bugs Found - https://forge.ourworld.tf/lhumina_code/hero_memory/issues/5 fixed in https://forge.ourworld.tf/lhumina_code/hero_memory/pulls/9 - https://forge.ourworld.tf/lhumina_code/hero_memory/issues/6 fixed in https://forge.ourworld.tf/lhumina_code/hero_memory/pulls/10 - https://forge.ourworld.tf/lhumina_code/hero_memory/issues/7 fixed in https://forge.ourworld.tf/lhumina_code/hero_memory/pulls/11

fatmaebrahim commented

2026-06-11 15:16:22 +00:00

Author

Member

Deps References

All git dependencies pointed to development branch instead of main:

herolib_derive
herolib_openrpc
herolib_core
hero_lifecycle
hero_admin_lib
hero_proc_sdk
herolib_ai
herolib_os
hero_db_sdk
hero_archipelagos_core

Fixed in #8

### Deps References All git dependencies pointed to development branch instead of main: - herolib_derive - herolib_openrpc - herolib_core - hero_lifecycle - hero_admin_lib - hero_proc_sdk - herolib_ai - herolib_os - hero_db_sdk - hero_archipelagos_core Fixed in https://forge.ourworld.tf/lhumina_code/hero_memory/pulls/8