Comments (4)
Hello, I am currently in college and in a Software Engineering class where one of our assignments requires us to contribute to an open source project, specifically in the form of a bug fix or feature request. If possible, would I be able to be assigned this task? I have lots of experience with C++ so this feature request is in my scope of ability.
from llama.cpp.
Cool, ping here if you have question. Please try to open the PR when all checks pass on your fork. Good luck!
from llama.cpp.
A test scenario should be included with the changes
from llama.cpp.
Cool thank you!
from llama.cpp.
Related Issues (20)
- Generating the same token (token '1') over and over, after a few successful messages? HOT 4
- server `/embedding` api doesn't handle cases when physical batch size < prompt length. HOT 1
- Quantization ok but check_tensor_dims: tensor 'output_norm.weight' HOT 1
- b2950 broke RPC mode HOT 3
- Please don't hoard memory. HOT 1
- Why is convert-lora-to-ggml.py removed? HOT 2
- Potential string overflow in stbi_parse_png_file function
- [server] phi-3 uses <|endoftext|> instead of <|end|> when applying chat template in /chat/completions HOT 1
- Still not working with Meta-Llama-3-8B-Instruct HOT 1
- Phi 3 medium/small support HOT 31
- Problems about Hugging Face model to the gguf format. HOT 3
- Performance Regression Observed in llama.cpp HOT 3
- FR: Phi-3-vision-128k-instruct implementation HOT 4
- Build fails with `ggml-vulkan.cpp:6880:80: error: cannot convert โggml_tensor*โ to โfloatโ` HOT 4
- Since last update Mistral models doesn't works anymore HOT 1
- regression: output is nonsense with latest commit and CUDA support enabled HOT 6
- How to convert Microsoft/trocr to ggml format
- Optimisation of per-token CPU activities for GPU inference HOT 2
- Understanding "wrong number of tensors" error when loading Llama3 model. HOT 3
- Is it possible to create a DLL for main.cpp?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama.cpp.