Comments (3)
scott-vsi
commented on September 3, 2024
1
Ya. I did (I posted a few comments in that linked issue). The v0.1.8 hosted on pypi is compiled against CUDA 12.1 (or so the README says), however, the version posted on the Releases page is compiled against CUDA 11.8 (cu118). I tried them both (with torch v2.2.0 compiled against either CUDA 11.8 or 12.1, as needed) and couldn't get either to work. Although interestingly, I got different undefined symbol errors in the two cases.
What did work was autoAWQ (any version) and torch 2.0.1, both compiled against CUDA 11.8. EDIT torch 2.1.x also works
from txtai.
davidmezzetti
commented on September 3, 2024
Hello, thank you for sharing.
Did you try using the latest version of autoawq?
from txtai.
davidmezzetti
commented on September 3, 2024
Sounds good. I appreciate you documenting this and this should now come up if you run a search for "txtai autoawq errors" and so forth.
from txtai.
Related Issues (20)
- Add RAG API endpoint
- Rename Extractor pipeline to RAG
- Add RAG deepdive notebook
- json Response Error when trying to use ollama embeddings in txtai HOT 3
- Feature request : Advanced Reasoning and Inference HOT 1
- Feature request : Enhanced Geospatial and Temporal Search HOT 1
- Feature request : LLM Integration for Knowledge Graph Enhancement HOT 3
- Feature request : Advanced Ontology Management HOT 2
- Add RAG example application
- Segmentation fault when calling embeddings.index HOT 9
- Support max_seq_length parameter with model pooling
- Fix issue with setting quantize=False in HFTrainer pipeline
- Improve textractor pipeline
- Support `<pre>` blocks with Textractor
- Translation: AttributeError: 'ModelInfo' object has no attribute 'modelId' HOT 5
- Example code (10_Extract_text_from_documents.ipynb) does not work: No module named 'txtai.pipeline'; 'txtai' is not a package HOT 10
- Update HF LLM to reduce noisy warnings
- Add new functionality to RAG application
- pipeline not detected on MacOS HOT 4
- 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from txtai.