Giter VIP home page Giter VIP logo

Comments (3)

yumath avatar yumath commented on August 17, 2024

空白项是BERT在截断长度大于MAX_SEQ_LENGTH的句子的时候，会有一个[SEP]的标记留在句尾，会形成标记。但这个标记在标记映射中没有值，所以为空。
Accuracy就是标记正确率

from bertner.

lichunnan avatar lichunnan commented on August 17, 2024

十分感谢！不过我们实验室大神讲，bert本身是个很好的利用attention的模型，其实很多fine-tune没必要在bert上加很复杂的模型，比如NER只加一个简单的线性或crf性能可能就很好，你通过实验对这个有什么体会么？

from bertner.

yumath avatar yumath commented on August 17, 2024

@lichunnan 确实，只不过我实验的时候，可能超参数没调好。只用一层全连接fine-tune的时候，不太收敛，相比之下LSTM要容易训练一些。我用过官方给的接口，只加一层全连接，效果和LSTM相差无几

from bertner.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.