Comments (5)
Hey just released version 3.5.0 which includes support for LMStudio, please check it out and let me know your thoughts 😄
Many thanks,
from twinny.
Hey, thank you for the feature request.
I have decided to work on this in PR #98
I will keep you updated when it's ready. It's looking promising so far, I'd never heard of LM studio before this but it's really awesome, thanks for pointing me towards it.
Many thanks,
from twinny.
My pleasure. I am glad you like it as much as I do.
from twinny.
This is ready, closing.
from twinny.
Hi, i tried using it with
deepseek-coder:base
and getting this log on the server in lm studio
[2024-02-16 09:06:39.982] [INFO] [LM STUDIO SERVER] Processing queued request...
[2024-02-16 09:06:39.983] [INFO] Received POST request to /v1/completions with body: {
"model": "deepseek-coder:base",
"prompt": "<|fim▁begin|>\n\n// Language: Typescript (typescript) \n// File uri: file:///Users/Rainer.Burgstaller/git/emundo/exercises/dt-test-app/src/app/game-of-life.ts (typescript) \nclass Cell<|fim▁hole|><|fim▁end|>",
"stream": true,
"max_tokens": 250,
"temperature": 0.2
}
[2024-02-16 09:06:39.983] [INFO] Provided inference configuration: {
"n_threads": 4,
"n_predict": 250,
"top_k": 40,
"min_p": 0.05,
"top_p": 0.95,
"temp": 0.2,
"repeat_penalty": 1.1,
"input_prefix": "[INST]",
"input_suffix": "[/INST]\\n",
"antiprompt": [
"[INST]"
],
"pre_prompt": "",
"pre_prompt_suffix": "<</SYS>>[/INST]\\n",
"pre_prompt_prefix": "[INST]<<SYS>>\\n",
"seed": -1,
"tfs_z": 1,
"typical_p": 1,
"repeat_last_n": 64,
"frequency_penalty": 0,
"presence_penalty": 0,
"n_keep": 121,
"logit_bias": {},
"mirostat": 0,
"mirostat_tau": 5,
"mirostat_eta": 0.1,
"memory_f16": true,
"multiline_input": false,
"penalize_nl": true
}
[2024-02-16 09:06:39.983] [INFO] Streaming response..
[2024-02-16 09:06:39.984] [INFO] [LM STUDIO SERVER] Processing...
[2024-02-16 09:06:40.189] [ERROR] [Server Error] {"title":"unordered_map::at: key not found"}
[2024-02-16 09:06:40.191] [INFO] [LM STUDIO SERVER] Finished streaming response
[2024-02-16 09:06:40.191] [ERROR] [Server Error] {"code":"ERR_HTTP_HEADERS_SENT"}
[2024-02-16 09:06:40.195] [ERROR] [Server Error] {"code":"ERR_HTTP_HEADERS_SENT"}
I used the following model
and used the following twinny settings
from twinny.
Related Issues (20)
- Robot icon keeps spinning, no inference HOT 1
- Code completion not working HOT 19
- Code completion works, but chat just spins the progress circle indefinitely HOT 2
- Configured providers but twinny not sending any requests to provider. HOT 3
- Multiline completion is confusing HOT 1
- Code snippets in the chat window loose syntax highlighting occasionally HOT 6
- FIM doesn't work with Keep Alive = -1 HOT 1
- Cannot read long model names when configuring provider HOT 1
- Option to save provider configuration to disk HOT 1
- invalid option provided option="" HOT 5
- Codeqwen uses same FIM template as stable-code HOT 3
- Context Length Option With File Context Enabled Doesn't Limit Length HOT 1
- Chat workspace on right of visual code HOT 1
- Add OpenAI provider HOT 3
- FIM completion flexible context HOT 2
- Feature Request: Addition of a Visual Studio Plugin for Twinny HOT 1
- Sidebar shortcut/binding doesn t focus/unfocus properly
- Feature Request: newline shortcut in the prompt bindable HOT 5
- Interface lag after a number of messages in chat HOT 1
- Document RAG HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from twinny.