ryan
8fd6fa9ece
When llama-server is queue-backed it accepts the connection but never produces tokens; after ~60s Caddy drops the connection and the frontend clears loading state with no response and no error shown to the user. Backend: replace the async-for event loop with an explicit __anext__() iterator wrapped in asyncio.wait_for(). A 30s timeout (TTFT_TIMEOUT_SECONDS) applies only in the window between on_chat_model_start and the first content token — tool calls are excluded. On timeout, emits a stalled error event and logs it rather than waiting for the proxy to kill the connection. Frontend: separates stall errors from generic errors; shows a "Simba didn't respond in time. Retry" pill that re-sends the original query. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Rsbuild project
Setup
Install the dependencies:
pnpm install
Get started
Start the dev server, and the app will be available at http://localhost:3000.
pnpm dev
Build the app for production:
pnpm build
Preview the production build locally:
pnpm preview
Learn more
To learn more about Rsbuild, check out the following resources:
- Rsbuild documentation - explore Rsbuild features and APIs.
- Rsbuild GitHub repository - your feedback and contributions are welcome!