hhousen / docsum Goto Github PK

BART has a limit of 1024 tokens for the input.

How long documents are handled ?

How can I train the sum-model based on BART with my own dataset?

Hi i am trying to run the pressum from cmd_summarizer.py but getting this error. i think the path to huggingface is broken. Can you please guide me to run presumm.

Error : Traceback (most recent call last):
File "cmd_summarizer.py", line 51, in
summarizer = presumm.PreSummSummarizer()
File "/content/docsum/presumm/presumm.py", line 28, in init
model = BertAbs.from_pretrained("bertabs-finetuned-cnndm")
File "/usr/local/lib/python3.6/dist-packages/transformers/modeling_utils.py", line 877, in from_pretrained
**kwargs,
File "/usr/local/lib/python3.6/dist-packages/transformers/configuration_utils.py", line 347, in from_pretrained
config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/transformers/configuration_utils.py", line 400, in get_config_dict
raise EnvironmentError(msg)
OSError: Can't load config for 'bertabs-finetuned-cnndm'. Make sure that:

• 'bertabs-finetuned-cnndm' is a correct model identifier listed on 'https://huggingface.co/models'

• or 'bertabs-finetuned-cnndm' is the correct path to a directory containing a config.json file

hello,sorry if i use this space but i am very newbie whitout code knowledge
Is possible run on my local pc whit anaconda or ubutu or better whit google collab?

And if it's extractive - is it only selecting sentences? or can it form summaries at the word/token level?

For E-Books, would it be good to instead have an EPUB or MOBI converter?

Traceback (most recent call last):
File "run_summarization.py", line 325, in
main()
File "run_summarization.py", line 310, in main
evaluate(args)
File "run_summarization.py", line 34, in evaluate
model = BertAbs.from_pretrained("bertabs-finetuned-cnndm")
File "D:\anaconda3\lib\site-packages\transformers\modeling_utils.py", line 546, in from_pretrained
**kwargs,
File "D:\anaconda3\lib\site-packages\transformers\configuration_utils.py", line 202, in from_pretrained
config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "D:\anaconda3\lib\site-packages\transformers\configuration_utils.py", line 272, in get_config_dict
raise EnvironmentError(msg)
OSError: Couldn't reach server at 'https://s3.amazonaws.com/models.huggingface.co/bert/remi/bertabs-finetuned-cnndm-extractive-abstractive-summarization-config.json' to download pretrained model configuration file.

I'm trying to run the code but facing the above error. The code fails to download the config file saying the file not found.
Could you please help me to resolve this issue?
i tried to access the model directly using the provided link but it raises the error "no such key"

Hi ..Would you give me which Bart model you have used ? as i see in the code it is bart-large-cnn. But the summarisation results from this are better than what i get for https://huggingface.co/facebook/bart-large-cnn. Can you give me details of this ?