notani / ud_japanese-gsd Goto Github PK
View Code? Open in Web Editor NEWThis project forked from universaldependencies/ud_japanese-gsd
Japanese data from the Google UDT 2.0.
License: Other
This project forked from universaldependencies/ud_japanese-gsd
Japanese data from the Google UDT 2.0.
License: Other
# Summary This Universal Dependencies (UD) Japanese treebank is based on the definition of UD Japanese convention described in the UD documentation. The original sentences are from Google UDT 2.0. # Introduction The Japanese UD treebank contains the sentences from Google Universal Dependency Treebanks v2.0 (legacy): https://github.com/ryanmcd/uni-dep-tb. First, Google UDT v2.0 was converted to UD-style with bunsetsu-based word units (say "master" corpus). The word units in "master" is significantly different from the definition of the documents based on Short Word Unit (SWU) [1], then the sentences are automatically re-processed by Hiroshi Kanayama in Feb 2017. It is the Japanese_UD v2.0 and used in the CoNLL 2017 shared task. In November 2017, UD_Japanese v2.0 is merged with the "master" data so that the manual annotations for dependencies can be reflected to the corpus. It reduced the errors in the dependency structures and relation labels. Still there are slight differences in the word unit between UD_Japanese v2.1 and UD_Japanese-KTC 1.3. The manual segmentation work is ongoing by the group of Masayuki Asahara so that the divergence of the two Japanese treebanks should be fixed in the future. # Acknowledgments The original treebank was provided by: - Adam LaMontagne - Milan Souček - Timo Järvinen - Alessandra Radici via - Dan Zeman. The corpus was converted by: - Hiroshi Kanayama through discussion and validation with - Yusuke Miyao - Masayuki Asahara - Takaaki Tanaka - Yuji Matsumoto - Shinsuke Mori - Sumire Uematsu # License See file LICENSE.txt # Reference [1] Tanaka, T., Miyao, Y., Asahara, M., Uematsu, S., Kanayama, H., Mori, S., & Matsumoto, Y. (2016). Universal Dependencies for Japanese. In LREC. === Machine-readable metadata ================================================= Data available since: UD v1.4 License: CC BY-NC-SA 3.0 US Includes text: yes Genre: news blog Lemmas: automatic with corrections UPOS: converted with corrections XPOS: not available Features: not available Relations: converted with corrections Contributors: Kanayama, Hiroshi; Asahara, Masayuki; Miyao, Yusuke; Tanaka, Takaaki; McDonald, Ryan; Nivre, Joakim; Zeman, Daniel; Matsumoto, Yuji; Mori, Shinsuke; Uematsu, Sumire Contact: [email protected] =============================================================================== (Original treebank contributors: LaMontagne, Adam; Souček, Milan; Järvinen, Timo; Radici, Alessandra) Changelog 2017-11- v2.1 * Updates for v2.1. Several errors are removed by adding PoS/label rules and merging the manual dependency annotations in the original bunsetsu-style annotations in Google UDT 2.0. 2017-03-01 v2.0 * Converted to UD v2 guidelines. 2016-11-15 v1.4 * Initial release in Universal Dependencies.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.