Comments (2)
Hey @bonedaddy,
thanks for your time experimenting with spaGO!
For now, I implemented the BERT server to work with a single model:
type Server struct {
model *bert.Model
port int
}
The server structure may be modified to support multiple models simultaneously. For example, using a map whose keys are the names of loaded models. Something like:
type Server struct {
models map[string]*bert.Model
port int
}
However, this would complicate the loading phase and especially the routes.
This
http://127.0.0.1:1987/answer
would become something like
http://127.0.0.1:1987/MODEL_NAME/answer
I'm not sure adding this functionality is worth it. What do you think?
from spago.
Ah I see. Is there any reason why it wouldn't be advantageous to run the requests made to the BERT server against multiple models, and in cases like answer
requests, the client-side application could then use whatever response has the highest confidence score.
It would allow you to either initiate the BERT server with one model, or more than one model and have pseudocode like this:
var answers []answerStruct
for _, model := range Server::models {
result := model.askQuestion
answers = append(answers, result)
}
I'm not sure if this would be useful at all, but it might allow more accurate results to a wider variety of questions and answers, at the cost of lower performance
from spago.
Related Issues (20)
- Multi-label BERT classifier from PyTorch HOT 3
- bart-large-mnli multi_class does not agree with Python version HOT 7
- Suitable for categorising intents and slots? HOT 2
- Differences in the output of zero shot classification between python & spago for the same model HOT 1
- Nearly 4 times the memory usage when compared to python for the same model HOT 3
- Gorgonia tensors
- QA Chinese model result does not match python version HOT 2
- v1.0.0-alpha.0: operator gradients are sometimes null in non-obvious ways
- The `deepset` dir must created by manually HOT 4
- flair models no longer work HOT 2
- How to train a lstm network with spago? HOT 1
- how to convert hf models to spago format? HOT 2
- Comparing python and go gives different embeddings HOT 4
- I fucked up HOT 1
- is:issue is:open Issue with bert compiling Q6A example HOT 2
- Moved methods HOT 2
- Detailed Instructions? HOT 2
- Examples and documentation
- Question server example should use http not https
- Help with German zero shot HOT 16
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spago.