Comments (3)
I think so too. This likely requires changes on the BetterTransformer side. I'll close this for now, then
from spanmarkerner.
Hello!
As discussed internally on slack, it seems like BetterTransformer does not support attention matrices as are required for SpanMarker. See this Figure for an example attention matrix that I would use:
I'm afraid they only support attention masks, i.e. with shape [seq_length]
rather than [seq_length, seq_length]
.
- Tom Aarsen
from spanmarkerner.
yeah I was hopeful because the model translation worked without an error, but debugging it deeper it probably wont work without writing custom model translation code.
from spanmarkerner.
Related Issues (20)
- Prevent re-adding contextual information when training with document-level context
- Unexpectedly (bad) predictions? HOT 5
- How to make this work for overlapping entities? HOT 2
- Choose class-candidates during inference
- Note: (XLM-)RoBERTa-based SpanMarker models require text preprocessing HOT 3
- Integrate Entity Ruler with Span Marker model HOT 1
- SpanMarker with ONNX models HOT 10
- Cannot train BILOU scheme with no singletons HOT 1
- Hugging Face Space URL not working for FewNERD fine-tuned model HOT 2
- Confusing error thrown when tokens is empty
- should return same no. of list as of inputs HOT 6
- spaCy_integration `.pipe()` does not behave as expected HOT 1
- ValueError: Failed to concatenate on axis=1 because tables don't have the same number of rows HOT 4
- inference time cpu vs gpu HOT 3
- Error loading SpanMarkerTokenizer HOT 2
- SpanMarker library for document level context Gives Error. (RuntimeError: CUDA error: device-side assert triggered) HOT 3
- num_proc not specified in .map functions HOT 3
- Evaluation Metrics with Nervalute HOT 1
- Bert-based models crash HOT 3
- SpanMaker not working on custom dataset HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spanmarkerner.