Comments (3)
pseudotensor
commented on June 10, 2024
How did you install h2oGPT? It requires steps like this for cuda:
Lines 107 to 111 in 5b6b7b3
from h2ogpt.
InesBenAmor99
commented on June 10, 2024
I'm on windows, i followed the exact steps in the README_Windows. Additionally, when I ran 'import torch' and 'print(torch.cuda.is_available())', I got 'True'.
from h2ogpt.
pseudotensor
commented on June 10, 2024
So you did this step in the readme_windows?
* For non-CPU case, choose llama_cpp_python ARGS for your system according to [llama_cpp_python backend documentation](https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#supported-backends), e.g. for CUDA:
```cmdline
set CMAKE_ARGS=-DLLAMA_CUBLAS=on -DCMAKE_CUDA_ARCHITECTURES=all
set LLAMA_CUBLAS=1
set FORCE_CMAKE=1
Note for some reason things will fail with llama_cpp_python if don't add all cuda arches, and building with all those arches does take some time.
from h2ogpt.
Related Issues (20)
- doctr for scanned pdf HOT 6
- pytorch_model.bin 1.34G download hangs forever on Linux HOT 7
- umbrella podSecurityContext null values are always overwritten by sub-chart default values
- [Question] how model learn data from new document ? HOT 1
- EventListener Failure HOT 2
- GPU Installation HOT 18
- Enchance h2oGPT UI to have librechat like features. HOT 2
- Sepparate Upload Document to Database H2O and Query-Summary HOT 1
- Linux install of h2ogpt--Require corrections in install Instructions HOT 5
- failed to concatenate document_choice HOT 1
- question regarding model_lock HOT 2
- Executing small model but missing config.json error with microsoft/Phi-3-mini-4k-instruct-gguf HOT 1
- Q and A not working for Youtube HOT 7
- sentence transformer version HOT 2
- Logging/Saving Settings and Instructions for Inference Jobs HOT 6
- Youtube ingestion doesn't work HOT 3
- Youtube chat does not work HOT 1
- Timestamps issue in Youtube Chat
- Document Content Presentation Difference Between Built-In UI and Custom UI using Gradio client HOT 1
- Change AutoGPT Agent Embeddings Model HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h2ogpt.