Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state–of–the–art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop “Evaluation of NLP and Speech Tools for Italian”, EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective.
State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective / Attardi, Giuseppe; Basile, Valerio; Bosco, Cristina; Caselli, Tommaso; Dell’Orletta, Felice; Simonetta Montemagni, Null; Patti, Viviana; Simi, Maria; Sprugnoli, Rachele. - In: INTELLIGENZA ARTIFICIALE. - ISSN 1724-8035. - 9:1(2015), pp. 43-61. [10.3233/IA-150076]
State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective
Sprugnoli Rachele
2015-01-01
Abstract
Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state–of–the–art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop “Evaluation of NLP and Speech Tools for Italian”, EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.