java.lang.ArrayIndexOutOfBoundsException: 10000 about konlp HOT 4 CLOSED

Hi!
Can I get the Input text for example and sessionInfo()?
I need to reproduce the error.

from konlp.

input text has over million of lines , each line representing one korean tweet,
x=readLines("tweets20140520.txt")

The exception is happening in:
https://github.com/haven-jeon/HanNanum-Analyzer/blob/master/src/kr/ac/kaist/swrc/jhannanum/plugin/MajorPlugin/PosTagger/HmmPosTagger/KoNLPHMMTagger.java

I think the array out of bounds is happening because of: mn = new MNode[10000];
though it works fine with the input text of 100,000 of lines..

from konlp.

Thanks @ahikmat85 for reporting the issue! I would also like to replicate this error since konlpy has the same problem.

from konlp.

I think this weired, because '# of Eojeol * # of tags' can not exceed 100,000 on normal one sentence. So, this problem was related with specific abnormal sentence, not size of text.
I'm not sure I can get sentences you want to processe.

Next version of KoNLP will resolve with strong sentence detection logic.

from konlp.