Shared task on quality assessment for text simplification


Štajner, Sanja ; Popović, Maja ; Saggion, Horacio ; Specia, Lucia ; Fishel, Mark


URL: https://www.researchgate.net/publication/301229567...
Additional URL: http://www.lrec-conf.org/proceedings/lrec2016/work...
Document Type: Conference or workshop publication
Year of publication: 2016
Book title: qats2016 : LREC 2016 Workshop & Shared Task on Quality Assessment for Text Simplification (QATS), 28th May 2016, Portorož, Slovenia ; proceedings
Page range: 22-31
Conference title: Qats2016
Location of the conference venue: Portorož, Slovenia
Date of the conference: 28 May 2016
Author/Publisher of the book
(only the first ones mentioned)
:
Štajner, Sanja
Place of publication: Paris
Publishing house: ELRA-ERDA
Publication language: English
Institution: School of Business Informatics and Mathematics > Semantic Web (Juniorprofessur) (Ponzetto 2013-15)
School of Business Informatics and Mathematics > Praktische Informatik II (Stuckenschmidt 2009-)
Subject: 004 Computer science, internet
Keywords (English): text simplification , quality assessment , shared task
Abstract: This paper presents the results of the shared task of the Workshop on Quality Assessment for Text Simplification (QATS), which consisted in automatically assigning one of the three labels (good, ok, and bad) for each of the four aspects of automatically simplified English sentences, i.e. their grammaticality, meaning preservation, simplicity, and overall quality. We asked participants to submit a maximum of three systems (raw metrics and/or classifiers) for each aspect. We received a total of 10 raw metrics and 16 classifiers for each of the four aspects. In addition to that, we computed correlations for four standard MT metrics (BLEU, METEOR, TER and WER) as baselines. The collected scores were evaluated by Pearson correlation (how well each score metric correlates with the manually assigned values) and the classifiers were evaluated in terms of their accuracy, mean average error, root squared mean error and weighted F-scores.
Additional information: Online-Ressource

Dieser Eintrag ist Teil der Universitätsbibliographie.




+ Citation Example and Export

Štajner, Sanja ; Popović, Maja ; Saggion, Horacio ; Specia, Lucia ; Fishel, Mark (2016) Shared task on quality assessment for text simplification. In: qats2016 : LREC 2016 Workshop & Shared Task on Quality Assessment for Text Simplification (QATS), 28th May 2016, Portorož, Slovenia ; proceedings 2016 Paris [Conference or workshop publication]



+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item