Comments (3)
Interesting question! It is admittedly hard to say for certain what will happen in your case. But, I'd like to think--after controlling for other pretraining details--SpanBERT is still more used to longer spans than comparable models. If and when you get results, I'd love to hear about them. Thanks!
from spanbert.
Interesting question! It is admittedly hard to say for certain what will happen in your case. But, I'd like to think--after controlling for other pretraining details--SpanBERT is still more used to longer spans than comparable models. If and when you get results, I'd love to hear about them. Thanks!
I'm about to test the model, just a quick question: a data point in TACRED has the following format:
Considering the fact that for longer spans, it may not make much sense to have NER tags, should I provide the NER tags when I'm converting my inputs to TACRED format? Or is it enough just to include spans and their start and end indices in the token
list? I'm writing a new run_*.py
class for my task, but I'm basically trying to figure out which elements in a record are essential to be fed to SpanBERT for the type of relation extraction I described earlier.
from spanbert.
I think it should be ok to skip the tags for your task.
from spanbert.
Related Issues (20)
- What 's in train.txt and valid.txt these two files during preprocessing HOT 1
- Getting embeddings for spans
- How should i use train.py to load a SpanBERT model and continue pretraining it? HOT 2
- Could you provide uncased SpanBert? HOT 3
- spanBERT for Named Entity Recognition HOT 3
- About "Tokenization Step"
- About the pre-training train-test ratio
- How can i use the SpanBert to predict a span of tokens in some specific contex?
- continue pretraining HOT 1
- continue pretraining HOT 1
- TypeError: __new__() got multiple values for argument 'cls' HOT 3
- how to train spanBert NER ?
- How to continually pretrain SpanBERT starting from a model checkpoint? HOT 1
- pre-train model load failture
- Use existing pretrained model for retraining using SpanBERT
- MRQA datasets split
- Progress in Pretraining
- How to train model by changing the number of layers in the model?
- pretrained model
- Use spanbert model for Named Entity Recognition to predict on data
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spanbert.