Comments (7)
hi @dhimasyoga16 thank you for your interest in this repo. I am not sure what the question is asking.
Are you asking for how to fine-tune the bert-multilingual
model? For that, you need to check the huggingface model to see how to continue training bert-multilingual
with the mask language modeling objectives. See https://github.com/huggingface/transformers/tree/master/examples/language-modeling.
If you have already fine-tuned bert-multilingual
, you can feed in the model path to --model
when calling the score
function.
Feel free to follow up with more questions.
from bert_score.
Hi, thankyou so much for the quick assist and the answer.
I also feel sorry for my hard-to-understand question, my bad.
Can i ask one more question?
I've done feature extracting by running the extract_features.py
and it generates 17.3GB json file. Can i use that json file as my model?
Because i want the BERTScore to analyze Indonesian sentences/texts better.
Thankyou so much once again :)
from bert_score.
hi @dhimasyoga16 which extract_features.py
file are you talking about? is it in this repo?
if you have precomputed the features, you can modify the code (https://github.com/Tiiiger/bert_score/blob/master/bert_score/utils.py#L253) to load the features instead of computing them again.
from bert_score.
Hi, sorry for the inactivity of this issue.
Refer to this link : https://github.com/huggingface/transformers/tree/master/examples/language-modeling
How can i fine-tune the bert multilingual model in Indonesian language? Can i use a wikipedia dump file as a corpus?
from bert_score.
hi @dhimasyoga16 this is a question that is better posed to the huggingface repo. Hopefully they will have a detailed instruction.
We are not really experts on this topic.
from bert_score.
Hi, i've successfully created my language model using huggingface transformers.
When i'm trying to do a testing (using my own model of course), why does the --num_layers
affect the score?
For example, when i'm using --num_layers 2
it gave me lower score rather than when i'm using --num_layers 6
.
Any detailed explanation about this?
And which --num_layers
that will give better scoring accuracy?
Sorry for so much questions, i'm new to NLP.
from bert_score.
hi @dhimasyoga16 please see our paper for the effect of using different --num_layers
. basically, this argument controls which pre-trained layer of representations you are using. It is hard to say which --num_layers
would work best for you application without seeing any validation data from our side.
from bert_score.
Related Issues (20)
- Trying Custom BERT model HOT 1
- Coco challenge link expired
- Why is matplotlib needed?
- Nan of P score?
- Tensor dimension mismatch when using lang='en-sci' HOT 2
- Cache embeddings HOT 2
- DeBERTaV3 Support HOT 1
- BERT simple true / false comparison scoring seems wrong
- Question about human ratings
- score函数无法加载离线模型【已解决】
- BERTScore can match contextualized embeddings of `[SEP]`/`[CLS]` tokens
- is tokenizer max length correct? HOT 1
- AttributeError: 'RobertaTokenizerFast' object has no attribute 'max_len'
- Using Clinical Models as Model_Type in BertScore
- Mabey we cannot assert 'model_type' as a local path? HOT 6
- Scoring Question
- Report: MPS backend is working fine HOT 1
- RuntimeError
- EnvironmentError
- ModuleNotFoundError: No module named 'bert_score' HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bert_score.