lhumina_code/hero_aibroker
3
0
Fork 0
Code Issues 6 Pull requests 1 Projects Releases 3 Packages Wiki Activity Actions

aibroker downloads models — apply pattern uniformly to every provider #62

New issue
Open
opened 2026-05-06 17:07:19 +00:00 by mik-tf · 0 comments
mik-tf commented 2026-05-06 17:07:19 +00:00
Owner
Copy link

Overview

hero_aibroker already has a model-download path for at least one provider. Other providers either don't auto-download or require manual pre-staging. The meeting directive is: the broker downloads models, apps just call the client. Apply the existing pattern to every registered provider so no app or operator has to think about model presence.

Why

Meeting 2026-05-06: "now ai broker download models / need to do it everywhere".

Acceptance

  • Audit which providers currently auto-download vs require manual staging
  • Apply the same download pattern to providers that lack it (Whisper, Kokoro, parakeet, embeddings, image-gen, …)
  • First request to a provider whose model isn't local triggers a download with progress logged
  • Documented in aibroker README

Related

Source: meeting notes 2026-05-06.

## Overview `hero_aibroker` already has a model-download path for at least one provider. Other providers either don't auto-download or require manual pre-staging. The meeting directive is: **the broker downloads models, apps just call the client**. Apply the existing pattern to every registered provider so no app or operator has to think about model presence. ## Why Meeting 2026-05-06: "now ai broker download models / need to do it everywhere". ## Acceptance - [ ] Audit which providers currently auto-download vs require manual staging - [ ] Apply the same download pattern to providers that lack it (Whisper, Kokoro, parakeet, embeddings, image-gen, …) - [ ] First request to a provider whose model isn't local triggers a download with progress logged - [ ] Documented in aibroker README ## Related - META: [home#219](https://forge.ourworld.tf/lhumina_code/home/issues/219) - [hero_aibroker#47](https://forge.ourworld.tf/lhumina_code/hero_aibroker/issues/47) — broader refactor parent Source: meeting notes 2026-05-06.
mik-tf added this to the ACTIVE project 2026-05-06 17:31:46 +00:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
development
main
lab-latest
v0.1.1
v0.1.0
Labels
Clear labels   
prio_critical

   
prio_low

   
type_bug

   
type_contact

   
type_issue

   
type_lead

   
type_question

   
type_story

   
type_task
No labels
prio_critical
prio_low
type_bug
type_contact
type_issue
type_lead
type_question
type_story
type_task
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
ACTIVE
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
lhumina_code/hero_aibroker#62
No description provided.