summaryrefslogtreecommitdiffstats
path: root/src/serve.rs
AgeCommit message (Expand)AuthorLines
2024-08-31feat: webui support RAG (#815)sigoden-25/+67
2024-08-30feat: replace roles.yaml with roles/<name>.md (#810)sigoden-1/+1
2024-08-19fix: incomplete stream response in proxy LLM api (#796)sigoden-22/+44
2024-07-26refactor: several optimizations (#749)sigoden-2/+4
2024-06-22refactor: update readme and models.yamlsigoden-2/+2
2024-06-22refactor: some error messages (#627)sigoden-1/+1
2024-06-21feat: serve embeddings api (#624)sigoden-27/+93
2024-06-05refactor: rename `pass_max_tokens` to `require_max_tokens` (#562)sigoden-2/+2
2024-06-05feat: support RAG (#560)sigoden-9/+2
2024-06-01refactor: rename some client structs and methods (#555)sigoden-8/+6
2024-05-30refactor: rename `SendData` to `CompletionData` (#553)sigoden-5/+7
2024-05-18feat: support function calling (#514)sigoden-23/+28
2024-05-14refactor: minor refinementsigoden-1/+1
2024-05-14feat: allow binding model to the role (#505)sigoden-1/+1
2024-05-08refactor: split /data.json into /v1/models and /v1/roles (#494)sigoden-7/+14
2024-05-08refactor: model pass_max_tokens (#493)sigoden-2/+2
2024-05-07feat: support playground/arena webui (#487)sigoden-11/+88
2024-05-02refactor: improve serve (#477)sigoden-2/+4
2024-04-30feat: add `.set max_output_tokens` (#468)sigoden-1/+1
2024-04-29refactor: rename some structs (#457)sigoden-12/+12
2024-04-29feat: non-streaming returns completion stats (#456)sigoden-8/+31
2024-04-28refactor: improve serve responses (#455)sigoden-14/+27
2024-04-24refactor: change default address for api serveingsigoden-2/+2
2024-04-24feat: support customizing `top_p` parameter (#434)sigoden-0/+3
2024-04-24feat: serve all LLMs as OpenAI-compatible API (#431)sigoden-0/+364