diff options
| author | Kelvie Wong <kelvie@kelvie.ca> | 2024-01-30 03:43:55 -0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-01-30 19:43:55 +0800 |
| commit | 176ff6f83ecfcf044a7deffad61a33b43480cdc5 (patch) | |
| tree | 3a93f3f2c8249c396b9ef953bbd15b22c2a1be00 /config.example.yaml | |
| parent | a30c3cc4c1757245e704273b047b44edb8293602 (diff) | |
| download | aichat-176ff6f83ecfcf044a7deffad61a33b43480cdc5.tar.gz | |
feat: add `extra_fields` to models of localai/ollama clients (#298)
* Add an "extra_fields" config to localai models
Because there are so many local AIs out there with a bunch of custom
parameters you can set, this allows users to send in extra parameters to
a local LLM runner, such as, e.g. `instruction_template: Alpaca`, so
that Mixtral can take a system prompt.
* support ollama
---------
Co-authored-by: sigoden <sigoden@gmail.com>
Diffstat (limited to 'config.example.yaml')
| -rw-r--r-- | config.example.yaml | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/config.example.yaml b/config.example.yaml index 2263cce..08fb529 100644 --- a/config.example.yaml +++ b/config.example.yaml @@ -39,6 +39,8 @@ clients: models: - name: mistral max_tokens: 8192 + extra_fields: # Optional field, set custom parameters + key: value - name: llava max_tokens: 8192 capabilities: text,vision # Optional field, possible values: text, vision |