Comments (5)
Sure.
WebLLM is using TVM and compiling from C++ to WebAssembly, which is more performant but vastly more complicated. This is built to be both a solid educational reference as well as a place to start more complex projects from, being only written in a small amount of Javascript.
Considering using Javascript here has minor performance impacts vs. the simplicity it provides (mostly all computation is done on WebGPU, meaning Javascript isn't involved), this is preferable in various circumstances.
from webgpt.
@jingslunt It's using onnxruntimeweb, mature but no webGPU backend for now.
webgpu merged
microsoft/onnxruntime#14579
from webgpt.
Same question.
Also WebGPT is usually referring this paper in the field of LLM: https://arxiv.org/abs/2112.09332v3
Hope clarifying the project name decision
from webgpt.
Sure.
WebLLM is using TVM and compiling from C++ to WebAssembly, which is more performant but vastly more complicated. This is built to be both a solid educational reference as well as a place to start more complex projects from, being only written in a small amount of Javascript.
Considering using Javascript here has minor performance impacts vs. the simplicity it provides (mostly all computation is done on WebGPU, meaning Javascript isn't involved), this is preferable in various circumstances.
the same as this proj? https://xenova.github.io/transformers.js
from webgpt.
@jingslunt It's using onnxruntimeweb, mature but no webGPU backend for now.
from webgpt.
Related Issues (12)
- I get this error lol HOT 2
- kmeans.org unsupported browser message HOT 4
- SyntaxError: Unexpected token 'v', "version ht"... is not valid JSON HOT 1
- Error loading GPT2 on local HOT 7
- how to use your llm.ts library with this? HOT 1
- Strange behavior HOT 11
- No available adapters.
- Make note that Git LFS is required to the README or Index
- How slow is slow?
- Error on MacOS HOT 2
- Does "Unsafe WebGPU" flag still need to be set to "enabled"? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from webgpt.