[Apologies for cross-posting]
***************************
First Call for Participation
****************************
*TASK*: Assessing DIScourse COherence in Italian TEXts (DisCoTEX) @
EVALITA 2023
*Info*: https://sites.google.com/view/discotex/home
*Final Workshop*: September 7th-8th, 2023, Parma, Italy
We invite interested parties from academia and industry to participate
in the *DisCoTEX Task*, which will be held in the context of Evalita
2023 <https://www.evalita.it/campaigns/evalita-2023/>.
DisCoTEX is the first shared task focused on modeling discourse
coherence for Italian real-word texts. Coherence is a key property of
any well-organized text and it plays a fundamental role in human
discourse processing as well as in a number of NLP applications.
Inspired by previous literature on coherence modeling, the DisCoTEX task
will be articulated into two subtasks:
1. Last sentence classification: this is conceived as a binary
classification task. Specifically, given a short textual passage and an
individual sentence, participants will be asked to predict whether the
sentence follows or not, thus joining it to the passage gives out a
coherent or incoherent passage.
2. Human score prediction: this is conceived as a regression task in
which participants will be asked to predict the average coherence score
assigned by human raters to short passages (either in their original or
modified version).
Participants are free to participate in either one of them or both.
More details about the definition, source data and evaluation are
available at the task website <https://sites.google.com/view/discotex/home>.
Given the novelty of the task and the crucial role that coherence
modeling plays in a variety of application scenarios, we expect to
attract groups from communities working on distinct fields, such as
automatic essay scoring, readability assessment and document
summarization. Moreover, we hope that beyond the competition, the task
would rise the interest of scholars working on theoretical models of
coherence from a linguistic and a cognitive perspective, as well as
those involved in the interpretability of current language models based
on deep learning networks.
-----------------------
Important Dates
-----------------------
7th February 2023: training data available to participants
30th April 2023: registration closes
2nd – 9 May 2023: evaluation windows
30th May 2023: results notification to participants
14th June 2023: technical report from participants due to task organizers
28th June 2023: final reports from task organizers due to EVALITA chairs
10th July 2023: review deadline
25th July 2023: camera ready version deadline
7th-8th September 2023: EVALITA workshop in Parma
Updates will be made available at the Evalita 2023 website, check it often.
----------------
Organizers
----------------
Dominique Brunato*
Davide Colla**
Felice Dell'Orletta*
Irene Dini*
Daniele Paolo Radicioni**
Andrea Amelio Ravelli*
* ItaliaNLP Lab, Istituto di Linguistica Computazionale "Antonio
Zampolli" (ILC-CNR), Pisa
** Dipartimento di Informatica, Università degli Studi di Torino
----------------------------------------------------------------
Contacts:*[email protected]*
----------------------------------------------------------------*
*
__ Feel free to contact us for further information!
The DisCoTEX organizing committee
_______________________________________________
Corpora mailing list -- [email protected]
https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/
To unsubscribe send an email to [email protected]
