diff options
| author | dev <dev@localhost> | 2026-10-21 22:14:10 +0000 |
|---|---|---|
| committer | dev <dev@localhost> | 2026-10-21 22:14:10 +0000 |
| commit | 49a527fc22447b85a0fe6fb945a6ece4e18de260 (patch) | |
| tree | fac6a9f64f2de6fbdeac0e9df6fc73b67fe8a951 /src/serve.rs | |
| parent | 710f0daff34e4ae02cf906841117449bcf114198 (diff) | |
| download | aichat-49a527fc22447b85a0fe6fb945a6ece4e18de260.tar.gz | |
Thread idempotency key through the request path
Propagate the per-request Idempotency-Key (generated once in the retry
loop) through request construction so every retry attempt reuses the same
key rather than minting a new one.
- Add field to ChatCompletionsData.
- Generate a single key per logical request in chat_completions and
chat_completions_streaming.
- Thread the key through request_builder (macro-based clients), Bedrock,
and VertexAI so the header is attached once and reused on retries.
Diffstat (limited to 'src/serve.rs')
| -rw-r--r-- | src/serve.rs | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/src/serve.rs b/src/serve.rs index 9aad17a..0ed1833 100644 --- a/src/serve.rs +++ b/src/serve.rs @@ -316,6 +316,7 @@ impl Server { top_p, functions, stream, + idempotency_key: None, }; if stream { |
