summaryrefslogtreecommitdiffstats
path: root/src/rag/mod.rs
AgeCommit message (Collapse)AuthorLines
2024-06-27feat: implement native rag url loader (#660)sigoden-1/+2
2024-06-27refactor: agent rag use `documents` field other than `embeddings` dir (#658)sigoden-4/+8
2024-06-26feat: rag load websites (#655)sigoden-67/+95
2024-06-26feat: custom rag document loaders (#650)sigoden-4/+9
2024-06-25refactor: rag chunk contains path metadata (#647)sigoden-2/+4
2024-06-25feat: support rag-dedicated clients (jina and voyageai) (#645)sigoden-0/+1
2024-06-23refactor: embedding model add price and dimension (#636)sigoden-3/+6
2024-06-21refactor: rename model.max_concurrent_chunks to model.max_batch_size (#626)sigoden-5/+5
2024-06-21refactor: improve rag (#622)sigoden-39/+42
2024-06-21feat: support rerank (#620)sigoden-35/+83
2024-06-20feat: rag hybrid search (#618)sigoden-13/+88
2024-06-19refactor: rag add rag_minimum_score config (#617)sigoden-15/+12
2024-06-14refactor: add/modify rag-related config (#599)sigoden-28/+82
2024-06-13refactor: change spinner text for rag searching (#596)sigoden-1/+1
2024-06-13feat: add rag and bot related cli options (#595)sigoden-0/+3
2024-06-12feat: rag splitter supports languages (#593)sigoden-9/+20
2024-06-12refactor: load pdf/docx files (#592)sigoden-2/+1
2024-06-12refactor: rag default_chunk_size (#588)sigoden-12/+25
2024-06-11feat: support bot (#579)sigoden-8/+11
* feat: support bots * refactor with RoleLike * improve exiting session * make bot works with rag * refactor repl assert state * add bot banner * repl complete bots according bots.txt * fix on windows * remove threadpool executing function callings * adjust repl left_prompt * move bot config to global config.yaml * `.bot` throw err if funciton callings is not configured
2024-06-06refactor: config refinement (#570)sigoden-3/+2
2024-06-05feat: support RAG (#560)sigoden-0/+425
* feat: support RAG * support more embeddings models and implement concurrent embedding api * show the progress of addings paths * ignore embedding context when saving message * embedding model max_chunk_size => default_chunk_size * support pdf and pandoc formats (docx, epub, ipynb)