=======================
CALL FOR PAPERS
=======================

The 13th Linguistic Annotation Workshop (The LAW XIII)
https://sigann.github.io/LAW-XIII-2019

Held in conjunction with ACL 2019, Florence/Italy, August 2019
Sponsored by the ACL Special Interest Group on Annotation (SIGANN)



WORKSHOP DESCRIPTION
========================

Linguistic annotation of natural language corpora is the backbone of supervised methods for statistical natural language processing. It also provides valuable data for evaluation of both rule-based and supervised systems and can help formalize and study linguistic phenomena.

The LAW provides a forum for presentation and discussion of innovative research on all aspects of linguistic annotation, including creation/evaluation of annotation schemes, methods for automatic and manual annotation, use and evaluation of annotation software and frameworks, representation of linguistic data and annotations, evaluation of manual and automatically-produced annotations, etc.


SPECIAL THEME
=======================
We encourage submission of papers relating to this year's special theme: ***marking of information quality in discourse***, i.e., annotations that mark how the speaker/writer expresses assessments. These assessments may be explicit and/or implicit in discourse, and may reflect positions, beliefs, opinions, appraisals and/or assessments about written or spoken propositions, for example, how a politician shows in discourse the degree of truthfulness in one of his/her electoral promises, or how a reporter shows his/her degree of belief in what the politician stated. This might include the annotation of devices such as hedges (“Donald claims that the crowd size, if you can really trust him to measure it, was enormous.”), committed belief (“The winners of the contest will be announced tomorrow.“) or attitudes (“It is with great sadness that we have learnt about the death of 6 people in the accident.”).


WORKSHOP TOPICS
=======================
We welcome submissions of long and short papers, posters, and demonstrations, relating to the topics of the special theme and to any aspect of linguistic annotation, including:

== Annotation procedures ==
- Innovative automated and manual strategies for annotation.
- Machine learning and knowledge-based methods for automation of corpus annotation.
- Creation, maintenance, and interactive exploration of annotation structures and annotated data.

== Annotation evaluation ==
- Inter-annotator agreement and other evaluation metrics and strategies.
- Qualitative evaluation of linguistic representation.

== Annotation access and use ==
- Representation formats/structures for merged annotations of different phenomena, and means to explore/manipulate them.
- Linguistic considerations for merging annotations of distinct phenomena.

== Annotation schemes, guidelines and standards ==
- New and innovative annotation schemes, comparison of annotation schemes.
- Best practices for annotation procedures and/or development and documentation of annotation schemes.
- Interoperability of annotation formats and/or frameworks among different systems as well as different tasks, frameworks, modalities, and languages.
- Results on the application and evaluation of standards for (linguistic) annotation.

== Annotation software and frameworks ==
- Development, evaluation and/or innovative use of annotation software frameworks.


SUBMISSIONS and REVIEWING
=========================

Submissions should report original and unpublished research on topics of interest for the workshop. Accepted papers are expected to be presented at the workshop, and will be published in the workshop proceedings. They should emphasize obtained results rather than intended work, and should indicate clearly the state of completion of the reported results.

A paper accepted for presentation at the workshop must not be or have been presented at any other meeting with publicly available proceedings.

Submission is electronic, using the Softconf START conference management system. The submission site will be announced shortly.

Long/short paper submissions must use the official ACL 2019 style templates. Long papers must not exceed eight (8) pages of content. Short papers and demonstration papers must not exceed four (4) pages of content. References do not count against these limits.

Note: The supplementary material does not count towards page limit and should not be included in paper, but should be submitted separately using the appropriate field on the submission website.
All submissions must be in PDF format and must conform to the official style guidelines, which are contained in the template files that will become available on the conference website shortly.

Reviewing of papers will be double-blind. Therefore, the paper must not include the authors' names and affiliations or self-references that reveal the authors’ identity, e.g., "We previously showed (Smith, 1991) ..." should be replaced with citations such as "Smith (1991) previously showed ...". Papers that do not conform to these requirements will be rejected without review.
Authors of papers that have been or will be submitted to other meetings or publications must provide this information to the workshop co-chairs. Authors of accepted papers must notify the program chairs within 10 days of acceptance if the paper is withdrawn for any reason.

If you have any questions, please feel free to contact the program co-chairs (law-xiii-2019-chairs@googlegroups.com).


IMPORTANT DATES
=====================
All submission deadlines are at 11:59 p.m. PST
12 April 2019: Workshop Paper Due Date
17 May 2019: Notification of Acceptance
31 May 2019: Camera-ready papers due
1-2 August 2019: Workshop Date


Workshop Chairs
=================
Annemarie Friedrich (LMU Munich)
Deniz Zeyrek (Middle East Technical University, Ankara)


Organizing Committee
=================
Stefanie Dipper (Ruhr University Bochum)
Annemarie Friedrich (Saarland University)
Chu-Ren Huang (The Hong Kong Polytechnic University)
Nancy Ide (Vassar College)
Lori Levin (Carnegie-Mellon University)
Adam Meyers (New York University)
Antonio Pareja-Lora (Universidad Complutense de Madrid / ATLAS, UNED)
Massimo Poesio (University of Trento)
Sameer Pradhan (Boulder Learning, Inc.)
Ines Rehbein (Saarland University)
Manfred Stede (University of Potsdam)
Katrin Tomanek (OpenTable)
Fei Xia (University of Washington)
Nianwen Xue (Brandeis University)
Heike Zinsmeister (University of Hamburg)