-
Notifications
You must be signed in to change notification settings - Fork 5
/
results.html
48 lines (36 loc) · 3.96 KB
/
results.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
<html><head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252">
<title>Results and Collected Judgments - EMNLP 2017 Third Conference on Statistical Machine Translation</title>
<style> h3 { margin-top: 2em; } </style>
</head>
<body>
<center>
<script src="title.js"></script>
<p><h2>Home</h2></p>
<script src="menu.js"></script>
</center>
</p><p>The results of the shared task are summarized in the paper:</p>
<dl><dd>
<i>Findings of the 2017 Conference on Machine Translation</i><br>
Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Raphael Rubino, Lucia Specia and Marco Turchi <br>
<a href="http://www.statmt.org/wmt17/pdf/WMT17.pdf">pdf</a>,
<a href="http://www.statmt.org/wmt17/bib/WMT17.bib">bib</a>.
</dd></dl>
<p>The raw data is available here.</p>
<ul>
<li>News translation task <a href="http://data.statmt.org/wmt17/translation-task/wmt17-submitted-data-v1.0.tgz">submissions</a>, <a href="http://www.scss.tcd.ie/~ygraham/newstest2017-system-level-human.tar.gz">direct assessments</a>.
<li>Metrics task data, <a href="http://www.scss.tcd.ie/~ygraham/newstest2017-system-level-human.tar.gz">system-level human data</a> and <a href="http://www.scss.tcd.ie/~ygraham/newstest2017-segment-level-human.tar.gz">segment-level human data</a>, <a href="http://ufallab.ms.mff.cuni.cz/~bojar/wmt17-metrics-task-package.tgz">submissions and scripts to reproduce the results published in the metrics task paper</a>.</li>
<!--<li> IT translation task <a href="http://data.statmt.org/wmt16/it-translation-task/wmt16-it-submitted-data.tgz">submissions</a>, <a href="http://data.statmt.org/wmt16/it-translation-task/wmt16-it-task-judgements.tgz">human judgements</a> and <a href="http://data.statmt.org/wmt16/it-translation-task/wmt16-it-task-references.tgz">reference translations</a></li>
<li>Pronoun task: <a href="http://data.statmt.org/wmt16/pronoun-task/">training and test data, system submissions, and results</a></li>
<li><a href="http://www.statmt.org/wmt16/biomedical-translation-task.html">Biomedical task</a>: training and test datasets, monolingual corpus and analysis are availabe in our <a href="https://drive.google.com/drive/folders/0B3UxRWA52hBja0t2azlkN3d2elk">public folder</a>.</a></li>
-->
<li>Automatic post-editing task: <a href="https://bitbucket.org/turchmo/apeatfbk/src/01acb75840a56cd32b9a8fa434c2f03f069e89a8/WMT_Task/2017/?at=master">data, evaluation script, submitted runs and final results</a></li>
<li>Multimodal task: <a href="http://www.quest.dcs.shef.ac.uk/wmt17_files_mmt/mmt17_submissions.tar.gz">submissions</a>, <a href="http://www.quest.dcs.shef.ac.uk/wmt17_files_mmt/mmt17_task1_test.tar.gz">task 1 test data</a> and <a href="http://www.quest.dcs.shef.ac.uk/wmt17_files_mmt/mmt17_task1_human.tar.gz">task 1 human evaluation</a>.
<!--, and <a href="http://www.quest.dcs.shef.ac.uk/wmt16_files_mmt/mmt16_task2_test.tgz">Task 2 test data.</a>
-->
</li>
<li>Quality estimation task: <a href="http://www.quest.dcs.shef.ac.uk/wmt17_files_qe/qe17_submissions.tar.gz">submissions, baseline systems and gold-standard.</li>
</ul>
<p>You can also download the raw data from <a href="http://www.statmt.org/wmt07/results.html">WMT07</a>, <a href="http://www.statmt.org/wmt08/results.html">WMT08</a>, <a href="http://www.statmt.org/wmt09/results.html">WMT09</a>, <a href="http://www.statmt.org/wmt10/results.html">WMT10</a>, <a href="http://www.statmt.org/wmt11/results.html">WMT11</a>, <a href="http://www.statmt.org/wmt12/results.html">WMT12</a>, <a href="http://www.statmt.org/wmt13/results.html">WMT13</a>, <a href="http://www.statmt.org/wmt14/results.html">WMT14</a>, <a href="http://www.statmt.org/wmt15/results.html">WMT15</a>
and <a href="http://www.statmt.org/wmt16/results.html">WMT16</a>.</p>
</body></html>