The continual-bert from jdubpark

continual-bert's Introduction

Hi there! I'm Jongwon 👋

I'm a comp sci student at UIUC, born in Korea and lived abroad most of my life. I love blockchain.

🌱 Currently learning distributed systems & parallel programming. Also diving into the practical applications of zkML!

👯 I'm in love with the math behind DeFi, but not so much the current state of satured & self-referential DeFi tokenomics. I will never stop praising the beauty of distributed ledger tech and full ownership in blockchain.

🤔 In my free time, I like to ideate on consumer-friendly Web3 products that abstract away (multi-chain) blockchain, maybe with the help of AI.

💻 Working at Story Protocol. Built a DeFi product at Solana Labs as an intern, traded at Diffuse Funds, interned at Runtime Verification and MYTY, and won at various hackathons.

continual-bert's People

Contributors

Stargazers

Watchers

continual-bert's Issues

Failed to run the code

Thanks for sharing!

Yet I came across several issues when I try to replicate the experimental results with the code:

pyrogue in dependencies is misspelled of pyrouge
clean.py line 44 post_json should be pdf_json
fname not found in preprocessed data so I remove it from the data loader, is it necessary?

After I managed to fix the aforementioned issues, the code still cannot work. It raised CUDA ERROR.

RuntimeError: CUDA error: CUBLAS_STATUS_INTERNAL_ERROR when calling cublasCreate(handle)

I wonder if you can check out the error and help me fix it.

format of input data

Hi,
could you tell me which input format is required for the preprocessing (raw data)? And what is the content of metadata.csv file?
Would it be possible to upload some example data?
Thanks in advance!

Recommend Projects