Comments (2)
rockyzhengwu
commented on September 4, 2024
先得到模型分词结果，然后加入词典做机械分词，理论上并不能保证词典中的词会被分词，实际中给词典的词特别大的权重就可以实现词典中的词一定会被切分
from foolnltk.
dylgithub
commented on September 4, 2024
您好，由于个人能力有限所以也没看源码，请问您说的加入词典做机械分词的意思是基于模型的分词结果，把词典中的词在分词结果中再强制结合成词吗？jieba中是把词典的权重取log值作为边的权重，因为jieba是基于词典的分词工具，而foolnltk是基于神经网络的分词工具，这里的权重具体怎么使用的？望告知，谢谢！
from foolnltk.
Related Issues (20)
- 屏蔽warning HOT 1
- 詞性是參考哪個詞性標注集的,看不太懂分析出來的詞性代碼對應到的意義
- ImportError! HOT 2
- 请问能提供词性标注映射表吗?
- 最新错误。 HOT 2
- 您好，小伙伴，请您更新一下pypi上的代码包😁 HOT 1
- ImportError: DLL load failed: 找不到指定的模块 HOT 1
- when I import fool, a error occurs.
- 在引入模块时出错。Error raised when import fool module. HOT 2
- import的时候出错 HOT 2
- 训练集是开源的吗
- 刚看了一下源码，词性分词的时候好像是先分词然和识别的词性，为什么不在模型中一起识别，感觉这样可以联合学习特征
- 使用foolNLTK时出现错误“ModuleNotFoundError: No module named 'tensorflow.contrib'” HOT 2
- 请问一下，模型训练，使用的是哪个数据集呢
- 使用ner功能只能用gpu吗？
- 导出pb文件，export_model.py的错误
- 使用自定义词库，分词效果并没有提升
- FileNotFoundError: [Errno 2] No such file or directory: '/usr/fool/map.zip'
- 用户自定义词典包含数字时报错——ValueError: could not convert string to float
- 报错，FileNotFoundError: [Errno 2] No such file or directory: 'D:\\ProgramData\\Anaconda3\\envs\\deeplearning\\fool\\map.zip'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from foolnltk.