Please, consider participating and/or forwarding to colleagues and groups. ****We apologize for multiple postings of this e-mail****
---------------------------------------------------------------------------------------------------- Call for Participation ---------------------------------------------------------------------------------------------------- First Call for Participation EXIST 2023 at CLEF 2023 Task: EXIST 2023: sEXism Identification in Social neTworks Website: http://nlp.uned.es/exist2023/ EXIST is a series of scientific events and shared tasks on sexism identification in social networks that aims to capture sexism in a broad sense, from explicit misogyny to other subtle expressions that involve implicit sexist behaviours (EXIST 2021, EXIST 2022). The third edition of the EXIST shared task will be held as a Lab at CLEF 2023, which will take place on September 18-21, 2023, in the Centre for Research & Technology Hellas (CERTH), Thessaloniki, Greece. Social Networks are the main platforms for social complaint, activism and expression of opinions and personal views in general. Movements like #MeTwoo, #8M or #Time’sUp have spread rapidly. Under the umbrella of social networks, many women all around the world have reported abuses, discriminations and other sexist experiences suffered in real life. Social networks are also contributing to the transmission of sexism and other disrespectful and hateful behaviours. In this context, automatic tools not only may help to detect and alert against sexist behaviours and discourses, but also to estimate how often sexist and abusive situations are found in social media platforms, what forms of sexism are more frequent and how sexism is expressed in these media. Given the success of the tasks, EXIST 2023 is a follow up of the tasks addressed in previous years, while facing yet a new challenge: the identification of the intention of the author of the sexist message. Additionally, the main novelty will be the adoption of the “learning with disagreements” paradigm for the development of the dataset and for the evaluation of the systems. The adoption of this paradigm along with our effort to control bias in the annotations will allow us to evaluate whether including the different views and sensibilities of the annotators contributes to the development of more accurate and fairer NLP systems. Participants will be asked to classify tweets (in English and Spanish) according to the following three tasks: TASK 1 - Sexism Identification: a binary classification where systems have to decide whether or not a given text (tweets) contains sexist expressions or behaviours (i.e., it is sexist itself, describes a sexist situation or criticizes a sexist behaviour). TASK 2 - Source Intention: for the tweets that have been classified as sexist, the second task aims to classify each tweet according to the intention of the person who wrote it. We propose a ternary classification task: (i) direct sexist message, (ii) reported sexist message and (iii) judgemental message. TASK 3 - Sexism Categorization: once a message has been classified as sexist, the third task aims to categorize the message in different types of sexism (according to the categorization proposed by experts and that takes into account the different facets of women that are undermined). In particular, each sexist tweet must be categorized in one or more of the following categories: (i) Ideological and inequality, (ii) Stereotyping and dominance, (iii) Objectification, (iv) Sexual violence and (v) Misogyny and non-sexual violence. Although we recommend to participate in all subtasks, participants are allowed to participate just in one of them. During the training phase, the task organizers will provide to the participants the manually-annotated EXIST 2023 dataset. For the evaluation of the teams, the unlabelled test data will be released. We encourage participation from both academic institutions and industrial organizations. We invite the participants to register for the lab at CLEF 2023 Labs Registration site (http://clef2023-labs-registration.dei.unipd.it/registrationForm.php). Upon registration participants will receive information about how to join the Google Group about the EXIST 2023 shared task. Important Dates: * 14 November 2022: Registration open. * 13 February 2023: Training set available. * 27 March 2023: Development set available. * 10 April 2023: Test set available. * 28 April 2023: Registration closes. * 10 May 2023: Runs submission due. * 26 May 2023: Results notification. * 5 June 2023: Submission of Working Notes by participants. * 23 June 2023: Notification of acceptance (peer-reviews). * 7 July 2023: Camera-ready participant papers due. * 18-21 September 2023: EXIST 2023 at CLEF Conference. **Note: All deadlines are 11:59PM UTC-12:00 ("anywhere on Earth").** Organizers: Laura Plaza, Universidad Nacional de Educación a Distancia (UNED) Jorge Carrillo-de-Albornoz, Universidad Nacional de Educación a Distancia (UNED) Roser Morante, Universidad Nacional de Educación a Distancia (UNED) Enrique Amigó, Universidad Nacional de Educación a Distancia (UNED) Julio Gonzalo, Universidad Nacional de Educación a Distancia (UNED) Damiano Spina, Royal Melbourne Institute of Technology (RMIT) Paolo Rosso, Universitat Politècnica de Valencia (UPV) Contact: Contact the organizers by writing to: [email protected] Website: http://nlp.uned.es/exist2023/ [http://nlp.uned.es/exist2023/images/icon_hu9683616acaba39c3cdd30865f1cf9d69_4810_512x512_fill_lanczos_center_2.png]<http://nlp.uned.es/exist2023/> EXIST 2023 - nlp.uned.es<http://nlp.uned.es/exist2023/> We will carry out a “hard evaluation” and a “soft evaluation”. Hard evaluation: the hard evaluation will assume that a single label is provided by the systems for every example in the dataset.; Soft evaluation: the soft evaluation is intended to measure the ability of the model to capture disagreements, by considering the distribution of labels in the output as a soft label and ... nlp.uned.es AVISO LEGAL. Este mensaje puede contener información reservada y confidencial. Si usted no es el destinatario no está autorizado a copiar, reproducir o distribuir este mensaje ni su contenido. Si ha recibido este mensaje por error, le rogamos que lo notifique al remitente. Le informamos de que sus datos personales, que puedan constar en este mensaje, serán tratados en calidad de responsable de tratamiento por la UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA (UNED) c/ Bravo Murillo, 38, 28015-MADRID-, con la finalidad de mantener el contacto con usted. La base jurídica que legitima este tratamiento, será su consentimiento, el interés legítimo o la necesidad para gestionar una relación contractual o similar. En cualquier momento podrá ejercer sus derechos de acceso, rectificación, supresión, oposición, limitación al tratamiento o portabilidad de los datos, ante la UNED, Departamento de Política Jurídica de Seguridad de la Información<https://www.uned.es/dpj>, o a través de la Sede electrónica<https://sede.uned.es/> de la Universidad. Para más información visite nuestra Política de Privacidad<https://descargas.uned.es/publico/pdf/Politica_privacidad_UNED.pdf>.
_______________________________________________ Corpora mailing list -- [email protected] https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/ To unsubscribe send an email to [email protected]
