tool call in-flight resume

2026-05-02 22:03:43 -07:00
parent 2c32ca66e2
commit cf9832ca3b
3 changed files with 12 additions and 14 deletions
--- a/docs/api/streaming-chat.md
+++ b/docs/api/streaming-chat.md
@@ -150,6 +150,7 @@ Backend database remains source of truth.

 During stream:
 - Client may optimistically render accumulated `delta` text.
+- Backend persists each completed tool call as a `tool` message before emitting its `tool_call` SSE event, so chat detail refreshes can show completed tool calls while the assistant response is still running.

 On successful completion:
 - Backend persists assistant `Message` and updates `LlmCall` usage/latency in a transaction.