danielvarga / hunalign Goto Github PK

Hi,
I'm trying to align an Arabic-English text corpus by using the following command: src/hunalign/hunalign -text -hand=hand_align_file dict.txt ar.txt en.txt. I don't have a dictionary, so dict.txt is an empty text file. When I run it I get this error:

Reading dictionary...
20 hungarian sentences read.
0 english sentences read.
Sizes differing too much. Ignoring files to avoid a rare loop bug.

Am I missing something? Why aren't the english sentences read? Should I provide language codes when working with a different language than hungarian?

Closing the issue. It was my connection problem. Thanks!

Hi,

I was not able to connect to the server as a guest and download the source code file or the package.

Here are the steps I took:

1. Click ftp://ftp.mokk.bme.hu/Hunglish/src/hunalign/latest/hunalign-1.1.tgz
2. Connect to the server as a Guest on the pop-out window
3. Wait and nothing happens

Please help. Thanks!

I have two files structured like this:

The Author
The Book Name

Book I

The introduction text.

Chapter 1 The Beginning

The first sentence.

La autoro
La nomo di libro

Libro 1

La prefaca texto.

Chapitro I La Komenco

La unesma frazo.

The result of hunalign -text is:

The Author	La autoro	0.266667
The Book Name ~~~ 	La nomo di libro	0
Book I		-0.3
 ~~~ The introduction text.		-0.3
		0.3
Chapter 1 The Beginning	Libro 1	10.7
		0.3
The first sentence.	La prefaca texto. ~~~ 	0
	Chapitro I La Komenco	-0.3
		0.3
	La unesma frazo.	-0.3
		0.3

I.E. "Chapter 1" gets matched incorrectly to "Libro 1" (with a very high confidence score!), skewing the whole alignment - apparently, just because there is a number "1" at the both sides.

Could you add the following two projects to your Tools sections:

https://github.com/aoliverg/hunapertium - Dictionaries for hunalign created from Apertium's transfer dictionaries.
https://github.com/coezbek/hunalign-dict-muse - Dictionaries for hunalign generated from Facebook MUSE dictionaries.

Thanks!

Sorry, I accidentally wrote this issue in the wrong repository.