mathbert's People
Forkers
ajayarunachalam astroc86 seashellpeach aiainui jeffreyyooo sdtech-sakataniyoshihiro sihanwang-whu sridharasai sethpoulsen aluphiwe alvin-zylmathbert's Issues
KeyError: 'size' and more
Hello! I found this model on HuggingFace, it looks well but I can't run it. When I ran the pytorch example you gave in your doc it raise an error as below: (TF version is fine, but it needs pt weights)
Some weights of the model checkpoint at tbs17/MathBERT were not used when initializing BertModel: ['cls.predictions.bias', 'cls.predictions.decoder.bias', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.seq_relationship.weight', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight']
- This IS expected if you are initializing BertModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Traceback (most recent call last):
File "D:\...\lib\site-packages\transformers\tokenization_utils_base.py", line 250, in __getattr__
return self.data[item]
KeyError: 'size'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "...\test.py", line 33, in <module>
output = model(encoded_input)
File "...\test.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "...\test.py", line 944, in forward
input_shape = input_ids.size()
File "...\test.py", line 252, in __getattr__
raise AttributeError
AttributeError
中文 MathBERT
大佬,啥时候放一个中文的 MathBERT 出来呗,没有中文的应用的模型是没有灵魂的
PyTorch version of MathBERT
Thanks for the amazing work!
Can you provide a PyTorch version of MathBERT? I'm really not familiar with TensorFlow.
Cannot download anything from scripts/math_copora_data_process.py
It looks like a web scaper of online books, articles. But I did not crawl anything.
Representing math formulas by MathBERT
Hi,
In you paper I found that
Our data not only contains text but also math symbols and equations.
Could you tell me more about it? Did you compare your solution with other approaches which focus more on creating formula embeddings (like Tangent-CFT, Approach0 etc.)?
What formula format mathBERT required to be able to compare two formulas? Could you please provide me a simple code snippet?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.