The QCRI Educational Domain (QED) Corpus – ALT Website

Details

Table 1. Total number of parallel segments in the QED Corpus v1.4

en sp pt zhs zht tr pl ar fr cz ru it ja kr bg de th nl da hi
en 2.5M
sp 335K 479K
pt 231K 117K 291K
zhs 139K 52K 46K 281K
zht 117K 49K 48K 191K 231K
tr 169K 72K 67K 47K 51K 205K
pl 151K 88K 72K 47K 52K 65K 197K
ar 158K 83K 73K 58K 59K 90K 69K 185K
fr 125K 63K 58K 29K 29K 36K 59K 48K 161K
cz 132K 61K 65K 55K 56K 66K 69K 56K 40K 158K
ru 77K 39K 36K 22K 20K 18K 30K 29K 29K 25K 146K
it 97K 52K 49K 29K 29K 38K 43K 44K 39K 38K 23K 124K
ja 98K 44K 44K 46K 42K 47K 39K 48K 31K 43K 23K 29K 113K
kr 83K 36K 36K 30K 32K 28K 32K 37K 25K 30K 14K 28K 26K 109K
bg 79K 39K 44K 28K 33K 45K 44K 39K 33K 42K 15K 27K 21K 19K 100K
de 77K 49K 45K 22K 25K 30K 45K 36K 42K 35K 22K 30K 24K 23K 28K 99K
th 85K 50K 40K 31K 29K 56K 38K 45K 21K 29K 14K 22K 27K 15K 20K 20K 95K
nl 73K 43K 42K 25K 29K 33K 41K 40K 33K 41K 19K 31K 25K 22K 25K 30K 19K 85K
da 48K 27K 34K 18K 21K 29K 25K 30K 23K 32K 12K 21K 18K 16K 25K 16K 10K 21K 58K
hi 43K 26K 22K 14K 14K 17K 24K 25K 16K 17K 8K 26K 16K 14K 13K 13K 13K 17K 15K 48K

Table 2. Results for systems trained, tuned and tested on the QED Corpus v1.4 for translating into English are provided below*:

BLEU NISTv13 OOV
Source Lang. tst2014a tst2014b tst2014atst2014b
Spanish (sp) 48.2 41.4 0.6% 0.8%
Portuguese (pt) 52.1 46.6 0.7% 0.9%
Arabic (ar) 38.0 34.4 1.0% 1.2%
Polish (pl) 34.7 29.4 2.5% 2.4%
Czech (cz) 33.7 32.9 2.3% 2.6%
French (fr) 31.5 35.1 0.8% 1.1%
German (de) 35.2 34.0 2.3% 1.8%
Russian (ru) 34.3 38.6 1.8% 1.7%
Dutch (nl) 39.8 45.6 1.3% 1.4%
Danish (da) 40.5 35.3 2.5% 2.6%

*details about the SMT system configurations and settings are details in the paper.

Từ khóa » Http://alt.fit