CALL FOR PAPERS: THE 20TH LINGUISTIC ANNOTATION WORKSHOP (LAW-XX)
Linguistic annotation of natural language corpora is the backbone of
supervised methods in both statistical and neural natural language
processing. Annotated corpora are also a major supporting source of
information for unsupervised methods, multitask learning, and evaluation
of both NLP tools and theories about language within and outside of
linguistics. LAW-XX will provide a forum for presentation and discussion
of innovative research on all aspects of linguistic annotation,
including creation/evaluation of annotation schemes, methods for
automatic and manual annotation, use and evaluation of annotation
software and frameworks, representation of linguistic data and
annotations, semi-supervised "human in the loop" methods of annotation,
crowd-sourcing approaches, and more. LAW-XX will also provide a forum
for annotation researchers to work towards standardization, best
practices, and interoperability of annotation information and software.
SPECIAL THEME: ERRORS IN ANNOTATION
The special theme of LAW XX is Errors in Annotation. In addition to
LAW's general topics, we specifically invite submissions on the matter
of addressing annotations which are in some sense objectively incorrect
in their substance or omissions (c.f. Klie et al., CL 2023)--distinct
from annotator disagreement (Weber-Genzel et al., ACL 2024)--and the
role of error analysis in improving data quality for both
human-annotated and LLM-generated datasets. As data quality becomes
increasingly important (human-annotated or LLM-generated), it is
essential to develop techniques or tools to quantify data quality
(Swayamdipta et al., EMNLP 2020).
Potential topics covered include but are not limited to:
*
Annotation error detection
*
Annotation error correction
*
Error type classification
*
Error detection and correction in crowd-sourced annotations
*
Errors in LLM-generated annotations
IMPORTANT DATES
All submission deadlines are 11:59 p.m. UTC-12:00 ("anywhere on Earth").
*
Submission deadline: March 5, 2026
*
Pre-reviewed ARR commitment deadline: March 24, 2026
*
Notification of acceptance: April 28, 2026
*
Camera-ready papers due: May 12, 2026
*
Workshop Date: TBD
LAW XX will be hybrid, allowing both in-person and virtual
presentations.
SUBMISSION
We welcome submissions of long and short papers, posters, and
demonstrations relating to the special theme or any aspect of linguistic
annotation, including:
*
Annotation procedures
*
Innovative automated and manual strategies for annotation
*
Machine learning and knowledge-based methods for automation of corpus
annotation
*
Creation, maintenance, and interactive exploration of annotation
structures and annotated data
*
Annotation evaluation
*
Inter-annotator agreement and other evaluation metrics and strategies
*
Qualitative evaluation of linguistic representations
*
Innovative means to evaluate annotation quality
*
Annotation access and use
*
Representation formats/structures for annotations of different
phenomena, especially annotations* at multiple levels, and means to
explore/manipulate them
*
Linguistic considerations for merging annotations of distinct phenomena
*
Annotation schemes, guidelines and standards
*
New and innovative annotation schemes, comparison of annotation schemes
*
Methodologies and resources for annotation scheme development
*
Best practices for annotation procedures and/or development and
documentation of annotation schemes
*
Interoperability of annotation formats and/or frameworks among different
systems as well as different tasks, frameworks, modalities, and
languages
*
Results from the application and evaluation of standards for linguistic
annotation
*
Annotation software and frameworks
*
Development, evaluation and/or innovative use of annotation software
frameworks
Direct submission link:
https://openreview.net/group?id=aclweb.org/ACL/2026/Workshop/LAW
Pre-reviewed ARR commitment link:
https://openreview.net/group?id=aclweb.org/ACL/2026/Workshop/LAW_ARR_Commitment
Note on OpenReview's moderation policy for newly created profiles:
*
New profiles created without an institutional email will go through a
moderation process that can take up to two weeks.
*
New profiles created with an institutional email will be activated
automatically.
Submissions should report original and unpublished research on topics of
interest to the workshop. We also invite substantiated position papers,
in particular with regard to our special theme. Accepted papers are
expected to be presented at the workshop (either in-person or virtually)
and will be published in the workshop proceedings. They should emphasize
obtained results rather than intended work, and should indicate clearly
the state of completion of the reported results.
A paper accepted for presentation at the workshop must not be or have
been presented at any other meeting with publicly available proceedings.
Long/short paper submissions must use the official ACL style templates
[1]. Long papers must not exceed eight (8) pages of content. Short
papers and demonstration papers must not exceed four (4) pages of
content. References do not count against these limits.
Limitation and ethical consideration sections are optional and do not
count against these limits as well.
Note: The appendix also does not count against the page limit but should
not include essential details needed to understand/review the paper
(appendices can contain details such as hyperparameters, formulas,
proofs, and tables that are informative but not critical to the
understanding of the paper). All submissions must be in PDF format.
Reviewing of papers will be double-blind. Therefore, the paper must not
include the authors' names and affiliations or self-references that
reveal the authors' identity--e.g., "We previously showed (Chen et al.,
2024) …" should be replaced with citations such as "Chen et al. (2024)
previously showed …". Papers that do not conform to these requirements
will be rejected without review.
Authors of papers that have been or will be submitted to other meetings
or publications must provide this information to the workshop program
chairs ([email protected]). Authors of accepted papers
must notify the program chairs within 10 days of acceptance if the paper
is withdrawn for any reason.
Following the ACL and ARR policies [2], there is no anonymity period
requirement.
PREPARING THE CAMERA-READY VERSION
For the final version of your paper, make sure that you remove the
"review" option from the latex source file (\usepackage[review]{acl} →
\usepackage{acl}).
Final versions of accepted papers will be given one additional page of
content (up to 9 pages for long papers, up to 5 pages for short papers)
to address the reviewers' comments.
Please make sure to upload your final paper by May 12, 2026. Submissions
uploaded after that date will not be included in the proceedings.
If you have any questions, please feel free to contact the program
chairs at [email protected].
Links:
------
[1] https://github.com/acl-org/acl-style-files
[2]
https://www.aclweb.org/portal/content/report-acl-committee-anonymity-policy_______________________________________________
Corpora mailing list -- [email protected]
https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/
To unsubscribe send an email to [email protected]
