The past decade has seen a rise in academic work focussing on the computational tackling of lexical semantic change. An overview of the literature until 2018 is available in Tahmasebi et al. (2018) and Kutuzov et al. (2018). Nonetheless, most studies have different evaluation procedures and tackle different languages, corpora, and periods, making systems difficult to compare. This SemEval task aims to introduce a simple evaluation framework for unsupervised lexical semantic change detection. Tasks
There are two tasks: a classification task, and a ranking task. For each language, both tasks are based on the same two corpora, which span different periods. Corpora will be provided in four languages: German, English, Swedish, and Latin. Systems will be evaluated against a ground truth, as annotated (Schlechtweg et al., 2018) by human native speakers (except for Latin, which was annotated by scholars of Latin).
Swedish testdata available here, postevaluation data for all participating languages available here. Our task description paper is available on ArXiV.
The workshop will be held online on December 12-13, 2020.
