diff options
| author | sigoden <sigoden@gmail.com> | 2024-11-11 09:46:21 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2024-11-11 09:46:21 +0800 |
| commit | e18aa0169e80b8af9241e57f0ab66bf463ac8a4f (patch) | |
| tree | 49f5b07831894644e9e3ab3c291a2501190ebc56 /models.yaml | |
| parent | b2dbd73b8c8938105246f04e6ebcd68221740bd7 (diff) | |
| download | aichat-e18aa0169e80b8af9241e57f0ab66bf463ac8a4f.tar.gz | |
refactor: improve RAG (#982)
- set max default_chuck_size to 2000
- set default rag_top_k to 4
- change reciprocal_rank_fusion weights
Diffstat (limited to 'models.yaml')
| -rw-r--r-- | models.yaml | 10 |
1 files changed, 5 insertions, 5 deletions
diff --git a/models.yaml b/models.yaml index de82a60..80e3fc7 100644 --- a/models.yaml +++ b/models.yaml @@ -66,13 +66,13 @@ type: embedding input_price: 0.13 max_tokens_per_chunk: 8191 - default_chunk_size: 3000 + default_chunk_size: 2000 max_batch_size: 100 - name: text-embedding-3-small type: embedding input_price: 0.02 max_tokens_per_chunk: 8191 - default_chunk_size: 3000 + default_chunk_size: 2000 max_batch_size: 100 # Links: @@ -1004,12 +1004,12 @@ - name: text-embedding-3-large type: embedding max_tokens_per_chunk: 8191 - default_chunk_size: 3000 + default_chunk_size: 2000 max_batch_size: 100 - name: text-embedding-3-small type: embedding max_tokens_per_chunk: 8191 - default_chunk_size: 3000 + default_chunk_size: 2000 max_batch_size: 100 - name: meta-llama-3.1-405b-instruct max_input_tokens: 128000 @@ -1714,7 +1714,7 @@ max_input_tokens: 120000 input_price: 0.12 max_tokens_per_chunk: 16000 - default_chunk_size: 3000 + default_chunk_size: 2000 max_batch_size: 128 - name: rerank-2 type: reranker |