UD Japanese PUD
Language: Japanese (code: ja
)
Family: Japanese
This treebank has been part of Universal Dependencies since the UD v2.1 release.
The following people have contributed to making this treebank part of UD: Hans Uszkoreit, Vivien Macketanz, Aljoscha Burchardt, Kim Harris, Katrin Marheinecke, Slav Petrov, Tolga Kayadelen, Mohammed Attia, Ali Elkahky, Zhuoran Yu, Emily Pitler, Saran Lertpradit, Atsuko Shimada, Anna Trukhina, Martin Popel, Daniel Zeman, Hiroshi Kanayama.
Repository: UD_Japanese-PUD
Search this treebank on-line: PML-TQ
Download all treebanks: UD 2.2
License: CC BY-SA 3.0
Genre: news, wiki
Questions, comments? General annotation questions (either Japanese-specific or cross-linguistic) can be raised in the main UD issue tracker. You can report bugs in this treebank in the treebank-specific issue tracker on Github. If you want to collaborate, please contact [zeman (æt) ufal • mff • cuni • cz]. Development of the treebank happens directly in the UD repository, so you may submit bug fixes as pull requests against the dev branch.
Annotation | Source |
---|---|
Lemmas | not available |
UPOS | annotated manually in non-UD style, automatically converted to UD |
XPOS | not available |
Features | annotated manually in non-UD style, automatically converted to UD |
Relations | annotated manually in non-UD style, automatically converted to UD |
Description
This is a part of the Parallel Universal Dependencies (PUD) treebanks created for the CoNLL 2017 shared task on Multilingual Parsing from Raw Text to Universal Dependencies.
There are 1000 sentences in each language, always in the same order. (The sentence alignment is 1-1 but occasionally a sentence-level segment actually consists of two real sentences.) The sentences are taken from the news domain (sentence id starts in ‘n’) and from Wikipedia (sentence id starts with ‘w’). There are usually only a few sentences from each document, selected randomly, not necessarily adjacent. The digits on the second and third position in the sentence ids encode the original language of the sentence. The first 750 sentences are originally English (01). The remaining 250 sentences are originally German (02), French (03), Italian (04) or Spanish (05) and they were translated to other languages via English. Translation into German, French, Italian, Spanish, Arabic, Hindi, Chinese, Indonesian, Japanese, Korean, Portuguese, Russian, Thai and Turkish has been provided by DFKI and performed (except for German) by professional translators. Then the data has been annotated morphologically and syntactically by Google according to Google universal annotation guidelines; finally, it has been converted by members of the UD community to UD v2 guidelines.
Additional languages have been provided (both translation and native UD v2 annotation) by other teams: Czech by Charles University, Finnish by University of Turku and Swedish by Uppsala University.
The entire treebank is labeled as test set (and was used for testing in the shared task). If it is used for training in future research, the users should employ ten-fold cross-validation.
Acknowledgments
Statistics of UD Japanese PUD
POS Tags
ADJ – ADP – ADV – AUX – CCONJ – DET – NOUN – NUM – PART – PRON – PROPN – PUNCT – SCONJ – SYM – VERB
Features
Relations
acl – advcl – advmod – amod – appos – aux – case – cc – ccomp – compound – cop – csubj – dep – det – fixed – iobj – mark – nmod – nsubj – nummod – obj – obl – punct – root
Tokenization and Word Segmentation
- This corpus contains 1000 sentences and 26709 tokens.
- This corpus contains 26701 tokens (100%) that are not followed by a space.
- This corpus does not contain words with spaces.
- This corpus contains 37 types of words that contain both letters and punctuation. Examples: 、と, ドナルド・トランプ, B.C, 、という, 、を, G.D.P, HerFatherDidn't, Z.A, Zettel’sTraum, 、の, 」な, ウォルト・ディズニー, エル・グレコ, オート・ガロンヌ, オードリー・ヘプバーン, カサ・サンタ・マルタ, カステルフランコ・ヴェネト, サン・ゴーダン, シガー・ロス, シー・オブ・ジ・アンティレス, ジョン・ディ・ドメニコ, スティーラーズ・ホイール, ストレンジャー・シングズ, トーキング・デッド, ド・ゴール, ハーバード・ビジネス・スクール, バハ・カリフォルニヤ, ヒラリー・クリントン, フェデリコ・フェリーニ, フランツ・ヨーゼフ, プンタ・デル・エステ, プンタ・ラサ, マラー/サド, メラニア・トランプ, ラッセ・ハルストレム, ル・コント, ルーカス・クラナッハ
Morphology
Tags
- This corpus uses 15 UPOS tags out of 17 possible: ADJ, ADP, ADV, AUX, CCONJ, DET, NOUN, NUM, PART, PRON, PROPN, PUNCT, SCONJ, SYM, VERB
- This corpus does not use the following tags: INTJ, X
- This corpus contains 10 word types tagged as particles (PART): か, かどうか, さ, ね, 最大, 最高, 第, 紀元前, 約, 翌
- This corpus contains 26 lemmas tagged as pronouns (PRON): あなた, いずれ, かれら, ここ, これ, これら, そこ, その他, それ, それぞれ, それら, どこ, どちら, どれ, みなさん, よそ, 君たち, 彼, 彼ら, 彼女, 我々, 皆, 私, 私たち, 私達, 誰
- This corpus contains 4 lemmas tagged as determiners (DET): あの, この, その, どの
- This corpus contains 47 lemmas tagged as auxiliaries (AUX): ある, いく, いる, う, うる, える, おる, かける, かもしれる, くれる, させる, しまう, しめる, すぎる, する, せる, そうだ, た, たい, たら, たろ, だ, できる, でした, ない, なければ, なさる, なら, なる, べし, ます, やすい, ゆく, よい, ようだ, らしい, らす, られる, れる, 出す, 化, 始める, 来る, 終える, 続ける, 良い, 行く
- Out of the above, 16 lemmas occurred sometimes as AUX and sometimes as VERB: ある, いく, いる, かける, する, せる, できる, なさる, なる, 出す, 化, 始める, 来る, 終える, 続ける, 行く
- This corpus does not use the VerbForm feature.
Nominal Features
Degree and Polarity
Verbal Features
Pronouns, Determiners, Quantifiers
- Card
- NUM: 1, 2, 3, 一, 10, 4, 6, 20, 二, 億
Other Features
Syntax
Auxiliary Verbs and Copula
- This corpus uses 1 lemmas as copulas (cop). Examples: だ.
- This corpus uses 46 lemmas as auxiliaries (aux). Examples: た, する, だ, いる, れる, こと, ない, ます, ようだ, う, られる, せる, なる, おる, 来る, できる, たい, べし, 始める, かもしれる, しまう, なければ, 続ける, すぎる, える, たら, いく, かける, くれる, させる, そうだ, でした, 出す, 化, うる, しめる, たろ, なさる, なら, やすい, ゆく, らしい, らす, 終える, 良い, 行く.
Core Arguments, Oblique Arguments and Adjuncts
Here we consider only relations between verbs (parent) and nouns or pronouns (child).
- nsubj
- VERB--NOUN-ADP(が) (350)
- VERB--NOUN-ADP(だけ)-ADP(が) (1)
- VERB--NOUN-ADP(など)-ADP(が) (3)
- VERB--NOUN-ADP(の)-ADP(が) (2)
- VERB--NOUN-ADP(は) (388)
- VERB--NOUN-ADP(まで)-ADP(も)-ADP(が) (1)
- VERB--PRON-ADP(が) (30)
- VERB--PRON-ADP(は) (143)
- VERB--PRON-ADP(も)-ADP(が) (1)
- obj
- VERB--NOUN-ADP(だけ)-ADP(を) (1)
- VERB--NOUN-ADP(など)-ADP(を) (2)
- VERB--NOUN-ADP(の)-ADP(を) (2)
- VERB--NOUN-ADP(を) (701)
- VERB--NOUN-ADP(を)-ADP(はじめ) (1)
- VERB--NOUN-ADP(を)-ADP(も) (1)
- VERB--PRON-ADP(を) (18)
- iobj
- VERB--NOUN-ADP(だけ)-ADP(に) (1)
- VERB--NOUN-ADP(に) (497)
- VERB--NOUN-ADP(に)-ADP(しか) (1)
- VERB--NOUN-ADP(に)-ADP(は) (68)
- VERB--NOUN-ADP(に)-ADP(も) (7)
- VERB--NOUN-ADP(のみ)-ADP(に) (2)
- VERB--NOUN-ADP(まで)-ADP(に) (8)
- VERB--NOUN-ADP(まで)-ADP(に)-ADP(は) (2)
- VERB--PRON-ADP(に) (20)
- VERB--PRON-ADP(に)-ADP(は) (3)
- VERB--PRON-ADP(に)-ADP(も) (2)