Giter VIP home page Giter VIP logo

Comments (7)

louismartin avatar louismartin commented on July 17, 2024

Hello @monkdou0
Thanks for the issue.
As mentioned in the the last section of the README, the EASSE implementation fixes bugs and inconsistencies with previous versions of SARI that were used in earlier works.
The scores are not the same although similar.
We highly recommend to use this fixed version and recompute scores using the system outputs provided in the library.

from easse.

louismartin avatar louismartin commented on July 17, 2024

If you use the latest version of EASSE, you will get these results:

$ easse evaluate -t turkcorpus_test -m sari,bleu -i easse/resources/data/system_outputs/turkcorpus/test/Hybrid
{'bleu': 50.707, 'sari': 31.497}

Papers which use the latest version of SARI include: Multilingual Unsupervised Sentence Simplification.

from easse.

monkdou0 avatar monkdou0 commented on July 17, 2024

my version is 580bba7,
and the result is
➜ easse evaluate -t turkcorpus_test -m sari,bleu -i easse/resources/data/system_outputs/turkcorpus/test/Hybrid
{'bleu': 50.707, 'sari': 28.154}

from easse.

monkdou0 avatar monkdou0 commented on July 17, 2024

I have find what's wrong with me
THx! @louismartin

from easse.

louismartin avatar louismartin commented on July 17, 2024

Hi @monkdou0 do you mind sharing what was wrong with us?
It might help other people in the future!

from easse.

monkdou0 avatar monkdou0 commented on July 17, 2024

That is totally my own fault.
i change the code of the implementation of SARI function several days ago, and compile it today.
This repo is useful for the task of text simplification.
Very good! thx

from easse.

louismartin avatar louismartin commented on July 17, 2024

Ok thanks, closing the issue then!

from easse.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.