Comments (4)
Seems simple enough to hot swap, maybe make parent class that has .run() and gets similar inputs and outputs (+ kwargs)
Then choose if to use Google search or Vector Search or Local Search (pass info like paths to include)
from factool.
The things I've suggested are already possible with current solutions such as privateGpt or pdfgpt but it seems like factool is more robust and correct with higher accuracy, and also in terms of outputs which are consistent and easy to integrate with
from factool.
Read further, I see that "evidence" is what I'm looking for, basically I need to do hot swapping on evidence from online scraping and local files. If you can help show an example of how you recommend of doing this that would very appreciated 👍
from factool.
@fire17 Thank you for your interest on our work!
Indeed adding private knowledge support to FacTool is on our priority list!
To achieve this, we have to change this file link, so that the tool is querying from your own database (or vector database) rather than querying from the search engine.
Let me know if you have more questions! Thank you!
from factool.
Related Issues (20)
- Improving the implementation of env variables in gradio
- encapsulate for environment variable reference
- Change the current prompts to OpenAI function calling prompts
- An error of google serper HOT 4
- Add mode for factool - Standards for judging factuality
- create a doc to detail how to change openai-based models to customized models
- Allow users/developers to customized llms of different modules (e.g., claim extraction, question generation)
- RuntimeError in Jupyter Notebook HOT 2
- How are the metrics: acc, precision, recall of claim level calculated? HOT 4
- 请教一下如何使用azure接口的openai api-key? HOT 1
- ###evaluate###kbqa###error HOT 2
- Where to download FactPrompts dataset? HOT 4
- How many shots are used for evaluation of HumanEval? HOT 3
- Error with Factool Installation and Execution HOT 7
- Exception handling when calculate average claim_level_factuality
- Code for claim extraction evaluation HOT 1
- Add feature: Evaluate factuality of LLMs on our benchmark with one command.
- UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 5856: character maps to <undefined>
- AttributeError: 'ClientResponseError' object has no attribute 'get'
- Add feature: Print the total cost of querying the various APIs for a given run
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from factool.