add Hero Cloud Explorer service for multi-node orchestration #5

Merged

mahmoud merged 14 commits from development_explorer into development 2026-03-08 12:09:25 +00:00

Conversation 0 Commits 14 Files changed 29 +574 -378

mahmoud commented 2026-03-05 15:16:21 +00:00

Owner

Copy link

Description

Introduces the hero_cloud_explorer crate. a new gateway service that aggregates multiple hero_cloud nodes into a single entry point. Nodes self-register via periodic heartbeats over Mycelium, and users can deploy VMs across any registered node without knowing backend addresses.

Changes

• Add hero_cloud_explorer crate with explorer.oschema and OSIS-generated server, types, and RPC modules
• Implement heartbeat system: nodes report specs, status, and Mycelium address every ~5 minutes
• Add node monitoring with configurable online/offline threshold detection
• Add explorer feature flag (default-on) for conditional compilation
• Centralize module declarations, remove inline #[path] imports
• Fix domain reference in hero_cloud_server/src/main.rs after domain extraction

Related Issues

• lhumina_code/hero_cloud#3

### Description Introduces the `hero_cloud_explorer` crate. a new gateway service that aggregates multiple hero_cloud nodes into a single entry point. Nodes self-register via periodic heartbeats over Mycelium, and users can deploy VMs across any registered node without knowing backend addresses. ### Changes - Add `hero_cloud_explorer` crate with `explorer.oschema` and OSIS-generated server, types, and RPC modules - Implement heartbeat system: nodes report specs, status, and Mycelium address every ~5 minutes - Add node monitoring with configurable online/offline threshold detection - Add `explorer` feature flag (default-on) for conditional compilation - Centralize module declarations, remove inline `#[path]` imports - Fix domain reference in `hero_cloud_server/src/main.rs` after domain extraction ### Related Issues - https://forge.ourworld.tf/lhumina_code/hero_cloud/issues/3

mahmoud added 6 commits 2026-03-05 15:16:21 +00:00

feat: add hero_cloud_explorer crate and heartbeat system ... b896bd8dd6

New crate: hero_cloud_explorer — multi-node VM orchestration gateway that
receives heartbeats from cloud nodes, stores their status, and proxies
VM operations to the correct backend.

Explorer components:
- OSchema: ExplorerNode type + ExplorerService with 12 RPC methods
- rpc.rs: node_heartbeat (upsert), node_list/get, proxied VM methods
- proxy.rs: Unix socket JSON-RPC client for backend forwarding
- heartbeat.rs: background monitor marks stale nodes offline

Server additions:
- heartbeat_sender.rs: periodic task pings explorers with node status
- EXPLORER_ADDRESSES env var: comma-separated explorer socket paths
- HEARTBEAT_INTERVAL_SECS constant (300s)

Makefile: run-explorer, logs-explorer, integrated into run/stop targets.

fix: add explorer feature gate and fix domain move in server main 38530a4aeb

style: fix formatting to pass cargo fmt --check 3b9d8378ab

refactor: centralize module declarations ... 1ea67885d1

- Move `constants`, `heartbeat`, `proxy` module declarations
- Place declarations within `rpc` subdirectory using relative paths
- Update all affected module import paths

style: Improve code formatting and import ordering ... 7e5b639780

- Reorder `use` statements
- Collapse multi-line function parameters
- Reformat RPC method handlers for conciseness
- Adjust spacing around code blocks

feat: Add node socket path to heartbeat and object ... 091552c5c3

- Add `socket_path` parameter to `node_heartbeat` RPC
- Store `socket_path` in `ExplorerNode` OSchema
- Update `node_heartbeat` lookup to use hostname
- Send node's socket path and mycelium IP in heartbeats
- Improve error logging and apply minor code formatting

mahmoud added 3 commits 2026-03-07 23:44:35 +00:00

Merge branch 'development' of ssh://forge.ourworld.tf/lhumina_code/hero_cloud into development 3a53c479e7

Merge branch 'development' of ssh://forge.ourworld.tf/lhumina_code/hero_cloud into development 70a13925dc

Merge branch 'development' into development_explorer 4eec1d5c32

mahmoud added 2 commits 2026-03-08 08:58:41 +00:00

Merge branch 'development' into development_explorer b9ae0a0e4a

Merge branch 'development_explorer' of ssh://forge.ourworld.tf/lhumina_code/hero_cloud into development_explorer b0aac1b60d

mahmoud force-pushed development_explorer from b0aac1b60d to 8a756551de 2026-03-08 08:59:58 +00:00 Compare

mahmoud added 1 commit 2026-03-08 09:46:18 +00:00

feat: enforce secret validation via CRUD hooks, update docs with secret auth examples ... 181a71f0e6

- Add trigger_get_pre and trigger_list_pre hooks (from hero_rpc update)
- Add thread-local secret context for passing secrets to CRUD hooks
- Scrub secret field from CRUD responses via vm_trigger_get_post
- Update docs/testing.md with secret params in all VM examples
- Add Security model section to docs/api.md

mahmoud added 1 commit 2026-03-08 11:32:55 +00:00

feat: enhance dev workflow and platform hypervisor ... 91668f6018

- Implement conditional hypervisor driver selection.
- Introduce `StubDriver` for non-Linux environments.
- Migrate local development from `zinit` to foreground scripts.
- Add `socat`-based `make proxy-*` targets for local access.
- Update `Cargo.lock` for various crate dependencies.

mahmoud added 1 commit 2026-03-08 11:44:03 +00:00

build: specify chvm-lib dependency directly ... 15dc293f28

- Use git URL instead of workspace inheritance

mahmoud added 1 commit 2026-03-08 11:58:17 +00:00

refactor: Migrate chvm-lib to target_os cfg ... a025d0e463

- Update chvm-lib dependency source to HTTPS
- Downgrade getrandom and windows-sys versions
- Remove chvm Cargo feature
- Make chvm-lib dependency Linux-specific
- Replace `cfg(feature = "chvm")` with `cfg(target_os = "linux")`

mahmoud added 1 commit 2026-03-08 12:03:08 +00:00

refactor: remove unnecessary mutability from manager lock a7c26e0a73

mahmoud added 1 commit 2026-03-08 12:05:55 +00:00

refactor: use const for RefCell static initialization 191d50325a

mahmoud changed title from WIP: add Hero Cloud Explorer service for multi-node orchestration to add Hero Cloud Explorer service for multi-node orchestration 2026-03-08 12:09:15 +00:00

mahmoud merged commit feae626a39 into development 2026-03-08 12:09:25 +00:00

mahmoud deleted branch development_explorer 2026-03-08 12:09:25 +00:00

mahmoud referenced this pull request from a commit 2026-03-08 12:09:26 +00:00

add Hero Cloud Explorer service for multi-node orchestration (#5)

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels   

prio_critical

  

prio_low

  

type_bug

  

type_contact

  

type_issue

  

type_lead

  

type_question

  

type_story

  

type_task

No labels

prio_critical

prio_low

type_bug

type_contact

type_issue

type_lead

type_question

type_story

type_task

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

lhumina_code/hero_compute!5

No description provided.