• Affiliated to IEEE PerCom 2017
• March 13-17, 2017 (day to be confirmed)
• Kona (Big Island), Hawaii, USA

With ubiquitous systems relying more and more on large datasets for designing and testing models of users’ activities, the process of data labelling is becoming a major concern for the community. Labelling user data
is a central part of the design and evaluation of pervasive systems that aim to support the user through situation-aware reasoning. It is essential both in designing and training the system, either through the definition of a suitable situation model in knowledge-driven applications, or though the preparation of training data for learning tasks in data-driven models. Hence, the quality of annotations can have a significant impact on the performance of the derived systems. Labelling is also vital for validating and quantifying the performance of applications. In particular, comparative evaluations require the production of benchmark datasets based on high-quality and consistent annotations.

This workshop focuses on:

1. the role and impact of annotations in designing ubiquitous applications,
2. the process of labelling, and the requirements to produce high quality annotations, and 3. tools and automated methods for annotating user data.

The goal of the workshop is to bring these three topics to the attention of researchers from interdisciplinary backgrounds, and to initiate a reflection on possible resolutions of the related problems.
We invite you to submit papers with a maximum of 6 pages that offer new empirical or theoretical insights on the challenges and innovative solutions associated with labelling of user data, as well as on the impact that labelling choices have on the user and the developed system. The topics of interest include, but are not limited to:

• methods and intelligent tools for annotating user data for pervasive systems;
• processes of and best practices in annotating user data;
• methods towards an automation of the annotation;
• improving and evaluating the annotation quality;
• ethical issues concerning the annotation of user data;
• beyond the labels: ontologies for semantic annotation of user data;
• high-quality and re-usable annotation for publicly available datasets;
• impact of annotation on a ubiquitous and intelligent system’s performance;
• building classifier models that are capable of dealing with multiple (noisy) annotations and/or making
use of taxonomies/ontologies;
• the potential value of incorporating modelling of the annotators into predictive models.

Format: Maximum of 6 pages including references, formatted in accordance with the IEEE Computer Society author guidelines. The IEEE LaTeX and Microsoft Word templates, as well as related information, can be found at the IEEE Computer Society website (http://www.computer.org/web/cs-cps/authors). All papers included in the PerCom 2017 Workshops will appear in the conference proceedings published by IEEE.
Submission: Through the EDAS submission system (link to be provided) Review process: The review process will be double blind.
Registration: There will be no separate workshop registration, but one single registration will cover both conference and workshop participation. It is mandatory that at least one author will register and will participate to present the paper during the technical sessions of workshops.

================
Important dates:
================

Submission deadline: November 11, 2016
Notification: December 23, 2016
Camera ready version: January 13, 2017 (FIRM)
Author registration due by: January 13, 2017 (FIRM)
Workshop: March 13-17, 2017 (exact day TBC)

==================
Program Committee:
==================

Organisers
• Kristina Yordanova, University of Rostock, Germany
• Adeline Paiement, University of Bristol, UK
• Jesse Hoey, University of Waterloo, Canada

Challenge Organisers
• Niall Twomey, University of Bristol, UK
• Tom Diethe, University of Bristol, UK

Live Annotation Session Chair
• Max Schröder, University of Rostock, Germany

Committee Members
• Alison Burrows, University of Bristol, UK
• Niall Twomey, University of Bristol, UK
• Pete Woznowski, University of Bristol, UK
• Rachel King, University of Reading, UK
• Tom Diethe, University of Bristol, UK
• Thomas Kirste, University of Rostock, Germany
• Peter Flach, University of Bristol, UK
• Ian Craddock, University of Bristol and Toshiba Research, UK
• Gustaf Hendeby, Linköping University, Sweden
• Guang-Zhong Yang, Imperial College London, UK
• Thierry Declerck, German Research Centre for Artificial Intelligence, Germany
• Peter Haddawy, Mahidol University, Thailand
• Philipp Koldrack, German Center for Neurodegenerative Diseases, Germany
• Aftab Khan, Toshiba Research, UK
• Galia Angelova, Bulgarian Academy of Sciences, Bulgaria
• Frank Krüger, University of Rostock, Germany
• Sebastian Bader, University of Rostock, Germany
• Cecily Morrison, Microsoft Research Cambridge, UK
• Leandro Pecchia, University of Warwick, UK
• Aristodemos Pnevmatikakis, Athens Information Technology, Grece
• Praminda Caleb-Solly, University of the West of England, UK
• Antonio Krüger, Gearman Research Centre for Artificial Intelligence, Germany
• Thomas Ploetz, Newcastle University, UK
• Edith Law, University of Waterloo, Canada
• Alex Mihailidis, University of Toronto, Canada
• Diane Cook, Washington State University, USA
• Chris Nugent, Ulster University, UK
• Ian Cleland, Ulster University, UK
• Stephen Intille, Northeastern University, USA


For further information regarding the workshop and paper submission, please visit our webpage (www.irc-sphere.ac.uk/arduous-workshop) or contact Kristina Yordanova at kristina.yordanova@uni-rostock.de or Adeline Paiement at csatmp@bristol.ac.uk.