Comments (3)
Hello @ajratner,
Thanks a lot for your quick answer. Are you planning in a next release to provide a method that calculates automatically the dependencies? (I saw this TODO in the the train_model method of the gen model training)
In the meantime, what would you suggest to use to calculate the deps that meets your requirements in order to work with metal ?
Thanks
from metal.
Hi @Wronskia there are a number of differences (see resp. papers online), but at a high level:
- Model: By default, MeTaL uses a slightly more expressive model, where conditional accuracy parameters are learned, i.e. an accuracy parameter for each (LF, class) pair; whereas the default model in Snorkel is just learning a single acc. param per LF
- Speed: MeTaL uses a new matrix completion-style approach which involves running e.g. SGD over a small matrix---which importantly does not scale wrt to the amount of unlabeled data---and thus is much faster; see recent AAAI-19 paper for details!
As to instability, not sure without seeing examples, but we'll look into it.
And regarding deps: In the current matrix completion-style approach, we require the set of dependencies to meet certain requirements (which guarantee that the resulting problem is uniquely solvable). My guess is that the deps from Snorkel's selection approach just don't necessarily uphold/check for this criterion; but we should at least create a better error message! @paroma @fredsala
from metal.
Hi @Wronskia โย thanks for the question! I'll note that we've brought the best of MeTal to our v0.9 release of Snorkel โ check it out!
We have Dependency Learning on our roadmap there; stay tuned for updates! (cc @paroma )
from metal.
Related Issues (20)
- Using BERT with MeTaL HOT 6
- KeyError: 'METALHOME' error from MMTL_Basics tutorial HOT 1
- [QUESTION] Mixing textual and numerical inputs with multi-branch models HOT 2
- MMTL training accuracies swinging between two datasets HOT 3
- issue keras or Tensorflow in the future? HOT 1
- multiple
- when applying metal, how to estimate noisy-label probability for multilabel problem of a single task HOT 2
- Keep track of changes as CHANGELOG HOT 2
- I think there are some errors in the mt_end_model.py HOT 1
- Potential bug for the predict_proba function in label_model.py
- How to use weak supervised learning with MMTL HOT 1
- links to basic snorkel tutorials are broken. HOT 1
- How does an end model improve upon Snorkel? HOT 1
- End model seems to always do better when assuming a 50/50 class balance HOT 1
- Supporting "default" class HOT 1
- Question on LF influence on Snorkel predictions based on coverage HOT 1
- Change LF stat "empirical accuracy" to "precision" HOT 1
- Problems with networkx when using LabelFunction HOT 1
- Singular error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from metal.