Comments (6)
Hi, can you provide the BBC IDs of those articles?
from entfa.
If id
in the huggingface dataset format means BBCID, then:
from datasets import load_dataset
dataset = load_dataset("xsum", split='train')
error_cases = [240, 349, 398, 646, 679, 957, 1003, 1293, 1501, 1516, 2006, 2069, 2123, 2811, 3160, 3354, 3679, 4015, 4102, 4833, 5392, 5852, 6214, 6564, 6915, 6930, 7379, 7481, 8043, 8159, 8718, 9473, 9648, 9763, 10456, 10717]
for i, d in enumerate(dataset):
if i in error_cases:
print(d['id']+'\t')
will get a list of BBC IDs:
36202526 32593929 39474558 36036068 31569808 36092657 34559662 35518696 19380083 35149409 24617644 33304636 35361241 11400950 37709478 34048486 31300982 37882855 36598379 33025540 38782655 38841689 32157204 33656520 27614689 35932945 37624948 35925828 36074292 33550481 21850495 40484051 17550407 37736693 31100890 35152888
from entfa.
Thank you. What summaries are you evaluating? the reference summaries or model generated summaries?
from entfa.
Reference summaries (test.target)
from entfa.
same problem here, for both reference and model's outputs, any update?
from entfa.
same problem here, for both reference and model's outputs, any update?
The BART tokenizer seems to have a strange tokenization behavior when there are accents. Fixed for now by skipping those samples.
from entfa.
Related Issues (6)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from entfa.