summaryrefslogtreecommitdiffstats
path: root/src/client/model.rs
AgeCommit message (Collapse)AuthorLines
2024-03-06refactor: rename model's `max_tokens` to `max_input_tokens` (#339)sigoden-11/+11
BREAKING CHANGE: rename model's `max_tokens` to `max_input_tokens`
2024-01-30feat: add `extra_fields` to models of localai/ollama clients (#298)Kelvie Wong-0/+21
* Add an "extra_fields" config to localai models Because there are so many local AIs out there with a bunch of custom parameters you can set, this allows users to send in extra parameters to a local LLM runner, such as, e.g. `instruction_template: Alpaca`, so that Mixtral can take a system prompt. * support ollama --------- Co-authored-by: sigoden <sigoden@gmail.com>
2024-01-13feat: supports model capabilities (#297)sigoden-0/+51
1. automatically switch to the model that has the necessary capabilities. 2. throw an error if the client does not have a model with the necessary capabilities
2023-11-27feat: support vision (#249)sigoden-2/+10
* feat: support vision * clippy * implement vision * resolve data url to local file * add model openai:gpt-4-vision-preview * use newline to concate embeded text files * set max_tokens for gpt-4-vision-preview
2023-11-07feat: allow the use of an unlisted model (#219)sigoden-0/+31
2023-11-07refactor: remove Model.client_index, match client by name (#218)sigoden-4/+2
2023-11-07refactor: rename Model.llm_name to name (#216)sigoden-3/+3
2023-11-03refactor: improve code quanity (#203)sigoden-0/+80
- update field name of ModelInfo - rename ModelInfo to Model