Comments (13)
I'll wait until @ash3n comments. If my analysis is correct, we should update the Read.me
from docproduct.
How much data points are in the askdocs , healthtap , and webmd csvs? Each of those should contain several hundred thousand data points each. @ash3n @JayYip Are there updated versions of those files?
from docproduct.
In the meanwhile, here's a link to the binary tfrecords files
https://drive.google.com/drive/u/8/folders/1wRc1jtl5Q0objpfualNFwpg4H575tmks
from docproduct.
Number of rows in healthtap, webmd, AskDocs is about 137000, 46200, 78000, respectively. I do not see a few hundred thousand data points per dataset as you mention.
Thanks for the tfrecords but not sure how helpful this will be for my work.
from docproduct.
@ash3n @JayYip I'm going through the chats regarding the data. Unless I missed something, I believe that is the total amount of data we have, ~300,000 question answer pairs, not 700,000. Health tap, askdocs, and webmd are the most significant datasets we have. All the other datasets have very low numbers compared to those three.
from docproduct.
I'm not very familiar with the size of data since I'm not the one who collected and parsed them.
from docproduct.
#15 (comment) - link expired
https://drive.google.com/drive/folders/1PymmjbrgfOIs-HJ7oBmjZKH8j4rYsGZj - link expired
Please provide working links
from docproduct.
@JayYip that's your folder
from docproduct.
Link restored. Please check.
from docproduct.
Still this link is not working - https://drive.google.com/drive/u/8/folders/1wRc1jtl5Q0objpfualNFwpg4H575tmks
from docproduct.
also @JayYip
from docproduct.
@Better-Boy restored. I'm running out of google drive space. @Santosh-Gupta @Better-Boy I wonder if you guys can help to store the data and start a PR to update links in README? Thanks.
from docproduct.
Sure, lets chat over the slack
from docproduct.
Related Issues (20)
- Need help understanding "Train Your Own QA Models" Tutorial HOT 8
- What were the 'loss' and 'qa_pair_batch_accuracy' you got when you trained on your entire dataset?
- File damage HOT 1
- Details regarding your Training on different Models.
- Replacing the pubmed v1.0 with v1.1 HOT 1
- possible to upload dataset on Kaggle? HOT 1
- pandas can't read_parquet Embedded File:- BioBertFolder/bertffn_crossentropy.zip HOT 3
- System requirements for pandas.load_parquet HOT 2
- Can you publish you tensor-board training trajectories? HOT 2
- Translation of BioBERT Tensorflow Weights HOT 1
- ImportError: cannot import name 'export_saved_model' HOT 3
- Continual training HOT 4
- Google Colab not running HOT 2
- ImportError: cannot import name 'dense_features' HOT 6
- Training Data HOT 1
- import tensorflow as tf error HOT 1
- "TF record not found"
- Train your own medical Q&A retrieval model
- ModuleNotFoundError: No module named 'docproduct', even after performing `!pip install docproduct` in official colab notebook. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docproduct.