Comments (3)
Hello, that's a good question. The models we release are trained on multiple EE datasets. When training on different datasets, we add a prefix to represent the schema of the data. For example, we use "" to represent the schema of the Maven dataset. However, due to limitations in data volume and model capacity, the models we release sometimes struggle to follow human instructions (i.e., the schema prefix).
We are currently researching how to align the model better for IE tasks to make it more adept at following human instructions.
from omnievent.
Thank you for your answer.
I'm still unclear though on these prefixes. It seems like you did not add them as special tokens in the tokenizer. Is it that you considered that treating them like any other word was not a problem or am I missing something?
For instance in the following google colab notebook, the author does add their prefix "<idf.lang>"
as a special token to the tokenizer: https://colab.research.google.com/github/KrishnanJothi/MT5_Language_identification_NLP/blob/main/MT5_fine-tuning.ipynb
from omnievent.
Thanks for the question. We trained two versions of the model: with prefixes added as special tokens or without. There is no significant difference between the results of these two. Previous work has also revealed the similar phenomenon (https://aclanthology.org/2022.aacl-short.21.pdf).
from omnievent.
Related Issues (20)
- 您好,如何将自己训练好的参数加载到模型中,完成事件抽取任务? HOT 1
- problems with installation HOT 1
- base_processor.py的136行是否有bug呢? HOT 5
- do_event_argument_extraction() missing 1 required positional argument: 'device' HOT 4
- There is a fatal bug ,please fix it . HOT 2
- 无法安装deepspeed HOT 1
- 运行EAE任务时出错 HOT 1
- Question / Potential Bug re: Seq2Seq Example HOT 1
- Can you provide a maven-ere Omnievent pretrained model used for event relation extraction? HOT 1
- readme里面的运行步骤 写到一个py文件中 HOT 1
- Constrained Decoding HOT 1
- ERE: Event Relation Extraction HOT 7
- 服务器连接不上huggingface,无法加载model,请教有没有什么更好的解决方案,谢谢! HOT 2
- ace2005-zh-novalue HOT 1
- Event Ontology HOT 1
- 成功安装后首次运行报错 HOT 8
- 运行环境 HOT 1
- 找不到train HOT 1
- No CUDA GPUs are available HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from omnievent.