Comments (4)
Thanks so much, that's really helpful! I also found @kz364 's version of the notebook, which uses their fork of repeng, solved the problem for me. It looks to me like they mainly just switched the repeng python dependency from 3.11 to 3.10 (and changed the batch size, but I'm guessing that's not related).
Many thanks for repeng, by the way, it's super cool!
from repeng.
As far as I can tell, it's some sort of strange conflict between the preinstalled numpy version on colab and the version that repeng wants (as a transitive dependency). For some reason, the colab version sticks around? This issue has more people with the same problem...
Haven't figured out a good permanent fix yet, but this seems to work:
- Make sure you're on a fresh runtime without
repeng
installed (Runtime > Disconnect and delete runtime
) - Make a new cell at the top of the notebook and paste this:
%pip install --no-deps repeng
%pip install gguf
- Run it, then run the rest of the notebook as usual.
Hope this helps!
from repeng.
I think you can probably resolve this by restarting the runtime. My understanding is that the older version of numpy is imported automatically so the updated one doesn't work until you restart
from repeng.
Thanks!
from repeng.
Related Issues (19)
- Base model and vector merging HOT 1
- quantized model ? Llama cpp? HOT 3
- Control Vector Arithmetic HOT 3
- Error when running honesty.ipynb
- Q: repeng vs system prompt HOT 2
- How to load a different model? And how to avoid useless re-downloads? HOT 1
- question: how would you go about saving a control vector for later use HOT 4
- Installation HOT 1
- Will there be support for models with custom architecture (not only mistral or gpt based)? HOT 6
- Confused about dataset creation HOT 2
- Alternatives to PCA, such as umap HOT 6
- Computing the difference vectors for PCA HOT 1
- RuntimeError: "addmm_impl_cpu_" not implemented for 'Half' HOT 2
- vllm implementation HOT 4
- truncated_output_suffixes & HOT 2
- Cannot apply to other models HOT 2
- The MPS Backend is Not Working Properly HOT 11
- Slavoj Zizek vector is funny
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from repeng.