summaryrefslogtreecommitdiffstats
path: root/src/rag/mod.rs
AgeCommit message (Collapse)AuthorLines
2024-09-09refactor: abandon config `rag_min_score_rerank` (#852)sigoden-17/+23
2024-09-08feat: save rag in YAML instead of bin (#848)sigoden-10/+13
2024-09-08feat: support RAG-scoped rag_top_k and rag_reranker_model (#847)sigoden-17/+69
2024-09-08feat: tolerate failure to load some rag files (#846)sigoden-30/+3
2024-09-03feat: use dynamic batch size for embedding (#826)sigoden-3/+13
2024-08-12feat: support builtin website crawling (recursive_url) (#786)sigoden-0/+4
2024-07-29fix: unable to rebuild agent rag (#763)sigoden-1/+1
2024-07-28feat: ask for confirmation when some rag documents fail to load (#760)sigoden-19/+46
2024-07-11refactor: rag add documents (#700)sigoden-2/+12
2024-07-03refactor: update config.example.yaml and readme, fix typos (#682)sigoden-3/+3
2024-07-02refactor: improve RAG (#676)sigoden-2/+8
2024-07-01feat: support `.rebuild rag` repl command(#672)sigoden-109/+156
2024-06-28feat: `.file`/`--file` support URLs (#665)sigoden-2/+2
2024-06-27refactor: smart document splitter (#662)sigoden-11/+14
2024-06-27feat: implement native rag url loader (#660)sigoden-1/+2
2024-06-27refactor: agent rag use `documents` field other than `embeddings` dir (#658)sigoden-4/+8
2024-06-26feat: rag load websites (#655)sigoden-67/+95
2024-06-26feat: custom rag document loaders (#650)sigoden-4/+9
2024-06-25refactor: rag chunk contains path metadata (#647)sigoden-2/+4
2024-06-25feat: support rag-dedicated clients (jina and voyageai) (#645)sigoden-0/+1
2024-06-23refactor: embedding model add price and dimension (#636)sigoden-3/+6
2024-06-21refactor: rename model.max_concurrent_chunks to model.max_batch_size (#626)sigoden-5/+5
2024-06-21refactor: improve rag (#622)sigoden-39/+42
2024-06-21feat: support rerank (#620)sigoden-35/+83
2024-06-20feat: rag hybrid search (#618)sigoden-13/+88
2024-06-19refactor: rag add rag_minimum_score config (#617)sigoden-15/+12
2024-06-14refactor: add/modify rag-related config (#599)sigoden-28/+82
2024-06-13refactor: change spinner text for rag searching (#596)sigoden-1/+1
2024-06-13feat: add rag and bot related cli options (#595)sigoden-0/+3
2024-06-12feat: rag splitter supports languages (#593)sigoden-9/+20
2024-06-12refactor: load pdf/docx files (#592)sigoden-2/+1
2024-06-12refactor: rag default_chunk_size (#588)sigoden-12/+25
2024-06-11feat: support bot (#579)sigoden-8/+11
* feat: support bots * refactor with RoleLike * improve exiting session * make bot works with rag * refactor repl assert state * add bot banner * repl complete bots according bots.txt * fix on windows * remove threadpool executing function callings * adjust repl left_prompt * move bot config to global config.yaml * `.bot` throw err if funciton callings is not configured
2024-06-06refactor: config refinement (#570)sigoden-3/+2
2024-06-05feat: support RAG (#560)sigoden-0/+425
* feat: support RAG * support more embeddings models and implement concurrent embedding api * show the progress of addings paths * ignore embedding context when saving message * embedding model max_chunk_size => default_chunk_size * support pdf and pandoc formats (docx, epub, ipynb)