summaryrefslogtreecommitdiffstats
path: root/src/serve.rs
AgeCommit message (Expand)AuthorLines
2025-06-28chore: clippy (#1334)sigoden-1/+1
2025-02-13feat: abandon model field `no_temperature` (revert #1164) (#1170)sigoden-7/+2
2025-02-10feat: add model field `no_temperature` (#1164)sigoden-2/+9
2025-02-10feat: new model field `system_prompt_prefix` (#1163)sigoden-3/+1
2024-12-04refactor: improve retrieve model (#1036)sigoden-3/+5
2024-11-14refactor: improve tool calls (#995)sigoden-1/+1
2024-11-13fix: invalid request on qianwen multi tool-calls (#993)sigoden-1/+1
2024-11-11fix: WebUI unsupported value error when invoking o1-* models (#983)sigoden-1/+2
2024-11-09refactor: path related functions (#981)sigoden-6/+2
2024-10-19refactor: improve handling of no_stream/no_system_message (#936)sigoden-16/+39
2024-09-24refactor: embeddings/rerank fn accept ref data (#878)sigoden-2/+2
2024-09-09feat: proxy rerank api (#851)sigoden-2/+64
2024-09-09feat: proxy chat-completions api with tools support (#850)sigoden-50/+283
2024-09-06feat: add config `serve_addr` & env $SERVE_ADDR for specifying serve addr (#839)sigoden-2/+1
2024-09-06fix: render stream failed due to read cursor position timeout (#835)sigoden-1/+1
2024-08-31feat: webui support RAG (#815)sigoden-25/+67
2024-08-30feat: replace roles.yaml with roles/<name>.md (#810)sigoden-1/+1
2024-08-19fix: incomplete stream response in proxy LLM api (#796)sigoden-22/+44
2024-07-26refactor: several optimizations (#749)sigoden-2/+4
2024-06-22refactor: update readme and models.yamlsigoden-2/+2
2024-06-22refactor: some error messages (#627)sigoden-1/+1
2024-06-21feat: serve embeddings api (#624)sigoden-27/+93
2024-06-05refactor: rename `pass_max_tokens` to `require_max_tokens` (#562)sigoden-2/+2
2024-06-05feat: support RAG (#560)sigoden-9/+2
2024-06-01refactor: rename some client structs and methods (#555)sigoden-8/+6
2024-05-30refactor: rename `SendData` to `CompletionData` (#553)sigoden-5/+7
2024-05-18feat: support function calling (#514)sigoden-23/+28
2024-05-14refactor: minor refinementsigoden-1/+1
2024-05-14feat: allow binding model to the role (#505)sigoden-1/+1
2024-05-08refactor: split /data.json into /v1/models and /v1/roles (#494)sigoden-7/+14
2024-05-08refactor: model pass_max_tokens (#493)sigoden-2/+2
2024-05-07feat: support playground/arena webui (#487)sigoden-11/+88
2024-05-02refactor: improve serve (#477)sigoden-2/+4
2024-04-30feat: add `.set max_output_tokens` (#468)sigoden-1/+1
2024-04-29refactor: rename some structs (#457)sigoden-12/+12
2024-04-29feat: non-streaming returns completion stats (#456)sigoden-8/+31
2024-04-28refactor: improve serve responses (#455)sigoden-14/+27
2024-04-24refactor: change default address for api serveingsigoden-2/+2
2024-04-24feat: support customizing `top_p` parameter (#434)sigoden-0/+3
2024-04-24feat: serve all LLMs as OpenAI-compatible API (#431)sigoden-0/+364