server: refresh model catalog daily

2026-05-20 22:08:45 -07:00
parent 411790ee04
commit f79e5e02c5
3 changed files with 38 additions and 4 deletions
--- a/docs/api/rest.md
+++ b/docs/api/rest.md
@@ -40,6 +40,7 @@ Chat upload limits:
 ```
 - OpenAI model lists are filtered to models that are expected to work with the backend's Responses API implementation.
 - `hermes-agent` is included only when `HERMES_AGENT_API_KEY` is configured. Set it to Hermes `API_SERVER_KEY`, or any non-empty value if that local server does not require auth. `HERMES_AGENT_API_BASE_URL` defaults to `http://127.0.0.1:8642/v1`; set `HERMES_AGENT_MODEL` only when you need an additional fallback/override model id.
+- The backend loads provider model lists at startup and refreshes them about once every 24 hours. If a later provider refresh fails, the response keeps the last loaded model list for that provider and sets `error` to the latest failure message.

 ## Active Runs