This paper describes the organization and the results of the second edition of EvaLatin, the campaign for the evaluation of Natural Language Processing tools for Latin. The three shared tasks proposed in EvaLatin 2022, i. e. Lemmatization, Part-of-Speech Tagging and Features Identification, are aimed to foster research in the field of language technologies for Classical languages. The shared dataset consists of texts mainly taken from the LASLA corpus. More specifically, the training set includes only prose texts of the Classical period, whereas the test set is organized in three sub-tasks: a Classical sub-task on a prose text of an author not included in the training data, a Cross-genre sub-task on poetic and scientific texts, and a Cross-time sub-task on a text of the 15th century. The results obtained by the participants for each task and sub-task are presented and discussed.

Overview of the EvaLatin 2022 Evaluation Campaign / Sprugnoli, Rachele; Passarotti, Marco; Cecchini, Flavio Massimiliano; Fantoli, Margherita; Moretti, Giovanni. - ELETTRONICO. - (2022), pp. 183-188. ((Intervento presentato al convegno Second Workshop on Language Technologies for Historical and Ancient Languages tenutosi a Marseille, France nel 25th June 2022 [10.5281/zenodo.6655906].

Overview of the EvaLatin 2022 Evaluation Campaign

Sprugnoli, Rachele
;
2022-01-01

Abstract

This paper describes the organization and the results of the second edition of EvaLatin, the campaign for the evaluation of Natural Language Processing tools for Latin. The three shared tasks proposed in EvaLatin 2022, i. e. Lemmatization, Part-of-Speech Tagging and Features Identification, are aimed to foster research in the field of language technologies for Classical languages. The shared dataset consists of texts mainly taken from the LASLA corpus. More specifically, the training set includes only prose texts of the Classical period, whereas the test set is organized in three sub-tasks: a Classical sub-task on a prose text of an author not included in the training data, a Cross-genre sub-task on poetic and scientific texts, and a Cross-time sub-task on a text of the 15th century. The results obtained by the participants for each task and sub-task are presented and discussed.
Overview of the EvaLatin 2022 Evaluation Campaign / Sprugnoli, Rachele; Passarotti, Marco; Cecchini, Flavio Massimiliano; Fantoli, Margherita; Moretti, Giovanni. - ELETTRONICO. - (2022), pp. 183-188. ((Intervento presentato al convegno Second Workshop on Language Technologies for Historical and Ancient Languages tenutosi a Marseille, France nel 25th June 2022 [10.5281/zenodo.6655906].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11381/2925535
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact