Comments (3)
空白项是BERT在截断长度大于MAX_SEQ_LENGTH的句子的时候,会有一个[SEP]的标记留在句尾,会形成标记。但这个标记在标记映射中没有值,所以为空。
Accuracy就是标记正确率
from bertner.
十分感谢!不过我们实验室大神讲,bert本身是个很好的利用attention的模型,其实很多fine-tune没必要在bert上加很复杂的模型,比如NER只加一个简单的线性或crf性能可能就很好,你通过实验对这个有什么体会么?
from bertner.
@lichunnan 确实,只不过我实验的时候,可能超参数没调好。只用一层全连接fine-tune的时候,不太收敛,相比之下LSTM要容易训练一些。我用过官方给的接口,只加一层全连接,效果和LSTM相差无几
from bertner.
Related Issues (20)
- 如何 将生成的ckpt文件转换为pb文件
- 项目引用格式 HOT 1
- 训练出来模型,同样话predict出来结果不一致,大概是5次中有一次不一样 HOT 10
- ModuleNotFoundError: No module named 'tensorflow.contrib' HOT 1
- What is the use of the .dev file in data? HOT 3
- ner_predict.utf8预测结果的问题 HOT 2
- ValueError: Couldn't find 'checkpoint' file or checkpoints in given directory chinese_L-12_H-768_A-12/bert_model.ckpt HOT 1
- 代码复现第4步(训练)遇到问题 HOT 3
- 训练结果相关问题
- GPU没有被使用
- 如何加入早停机制呢,放钩子? HOT 1
- config_file HOT 1
- lstm_outputs = self.biLSTM_layer(lstm_inputs, self.lstm_dim, self.lengths)为什么 lstm_outputs的维度是(?,?,786)这里的问号为什么不是实数呢?) HOT 4
- 用其他数据集跑,因为数据集标签不同,报错“ KeyError: 'B-Project' ”,请问如何解决? HOT 2
- 请问data里的bio是怎么生成的,如何进行bio标注
- 没有日志 HOT 1
- 有关iteration step epoch的问题 HOT 1
- 有关评估指标的问题 HOT 5
- 请教一下 HOT 1
- 请教一下 precision recall为零的原因
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bertner.