summaryrefslogtreecommitdiffstats
path: root/src/utils/tiktoken.rs
AgeCommit message (Collapse)AuthorLines
2024-05-02chore: fix typos (#476)Tatsuya Kyushima-1/+1
2023-11-03fix: wrap and tokenize algorithm (#205)sigoden-111/+0
* fix: wrap and tokenize algorithm * update tests * remove unnecessary tokenize from tiktoken
2023-10-30fix: dry run on role or session (#181)sigoden-45/+153
2023-10-30chore: remove unnecessary clippy macrossigoden-2/+0
2023-07-10fix: minor code cleanup and pedantic lints (#134)Anthony Rubick-32/+31
2023-03-09feat: add remain tokens indicator and max tokens guard (#50)sigoden-0/+586