p-lambda / dsir Goto Github PK

Hi,

Can you release the code for the computation of KL reduction in Figure 3 in the paper?

Thank you very much!

Great work!

Could you provide the weights of BERT-style masked language models pretrained on the selected data?

Great work!
Thanks for releasing your DSIR-selected dataset through huggingface.

Any plans to release the selected-dataset according to the Heuristic classification method as well?

That will be great for reproducing efforts.

Kindly request to release code about DSIR with a neural importance weight estimator .

Hi,

We follow the training pipeline in experimental to replicate the DSIR results. However, our average performance reached only 81.05, significantly below the reported benchmark of 82.30. Are there any additional techniques or optimizations that we might have overlooked?

Hi,

I tried to run the pipeline in experimental. However, an error occured in compute_domain_idxs when I ran the resample. It seems to be that ds_path is used as a Path or string, but it is a list.