diff options
| author | dev <dev@localhost> | 2026-10-21 22:02:22 +0000 |
|---|---|---|
| committer | dev <dev@localhost> | 2026-10-21 22:02:22 +0000 |
| commit | 710f0daff34e4ae02cf906841117449bcf114198 (patch) | |
| tree | c542c044e8e20f416b25280a43309fe67a037736 /src/config/role.rs | |
| parent | 9d40159cad3b55c753ed02e7a4dee8cc7b6d15eb (diff) | |
| download | aichat-710f0daff34e4ae02cf906841117449bcf114198.tar.gz | |
Add idempotency support to aichat HTTP clients
- Add boolean to client config. When enabled, a
fresh (UUID) header is sent with each logical request
attempt so the outer retry loop reuses the same submission instead of
starting duplicate work on providers that support it (e.g. Sail Research).
The key is generated once per logical request (before the retry loop) and
reused across all retry attempts via the cloned ChatCompletionsData/request
builders, so providers debounce duplicate generations.
- Wire the header in request_builder (macro-based clients) and Bedrock's
chat_completions_builder.
- Document the option in config.example.yaml.
Diffstat (limited to 'src/config/role.rs')
0 files changed, 0 insertions, 0 deletions
