Overview of the Evaluation of Semantic Similarity and Textual Inference
Abstract
Recognizing Textual Entailment and Semantic Textual Similarity are two natural language processing tasks dealing with pairs of text passages. The former aims to determine whether the meaning of one passage entails the other, while the latter assigns a semantic similarity score to the pair. This paper presents the results of the ASSIN shared task and its corpus, annotated for both tasks in the Brazilian and European varieties of the language. The corpus differs from similar ones in the literature in its three RTE classes (Entailment, Paraphrase and Neutral), and for having been composed of sentences extracted from newswire texts. Six teams took part in the shared task, exploring different strategies.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
