Comments (2)
gaotianyu1350
commented on May 18, 2024
Hi Yash,
This is caused by truncating the mask token. For most of the templates, the mask token is put at the end of the sentence. If the input is too long and exceeds the max length, the mask token might be truncated. This can be solved by increasing the maximum length of the model
Best,
Tianyu
from lm-bff.
YashBit
commented on May 18, 2024
Dear Tianyu,
Thank you for your help. It works, I also limited the first_sent_len, so there is no error.
Regards,
Yash.
from lm-bff.
Related Issues (20)
- Question about prompt-based finetuning and automatic selection of label words HOT 3
- Negative CoLA MCC - Prompt-Based Finetuning error? HOT 2
- Bug in dataloader ? HOT 3
- Table 3 uses manual label words or generated label words? HOT 2
- Average the logits of 16 demonstrations HOT 1
- label generation problem HOT 2
- num_k parameter is not used HOT 4
- Bug in tools/ensemble.py/get_labels HOT 2
- A little question about the evaluation HOT 1
- lm_bff.json文件中相互关联的参数："inspired_templates", "replace_token_map_list"如何设置？ HOT 1
- Bug in get_sbert_embedding.py? HOT 2
- The issue for the loss of regression tasks HOT 1
- question about label words which consist of more than 2 sub tokens HOT 1
- Weird SST2 dataset size HOT 4
- Hyperparameter selection for Finetuning Full setting. HOT 1
- How can I create templates for right to left languages?
- Some questions regarding details of your paper results HOT 2
- Problem with the requirements file HOT 1
- cannot import name 'default_hp_search_backend' from 'transformers.integrations' HOT 4
- Adapting LM-BFF to WiC dataset
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lm-bff.