Artificial Intelligence (AI) technologies are widely used in computer applications to perform tasks such as monitoring, forecasting, recommending, prediction, and statistical reporting. They are deployed in a variety of systems including driverless vehicles, robot controlled warehouses, financial forecasting applications, and security enforcement and are increasingly integrated with cloud/fog/edge computing, big data analytics, robotics, Internet-of-Things, mobile computing, smart cities, smart homes, intelligent healthcare, etc. However, the quality assurance of existing AI application development processes is still far from satisfactory and the demand for being able to show demonstrable levels of confidence in such systems is growing. Software testing is a fundamental, effective and recognized quality assurance method which has shown its cost-effectiveness to ensure the reliability of many complex software-systems. However，the adaptation of software testing to the peculiarities of AI applications remains largely unexplored and needs extensive research to be performed. On the other hand, the availability of AI technologies provides an exciting opportunity to improve existing software testing processes, and recent years have shown that machine learning, data mining, knowledge representation, constraint optimization, planning, scheduling, multi-agent systems, etc. have real potential to positively impact on software testing. Recent years have seen a rapid growth of interests in testing AI applications as well as application of AI techniques to software testing. It is, therefore, timely to provide an international forum for researchers and practitioners to exchange novel research results, to articulate the problems and challenges from practices, to deepen our understanding of the subject area with new theories, methodologies, techniques, processes models, etc., and to improve the practices with new tools and resources. This is the aim of the IEEE conference on AI Testing.

===================================================================================

Topics of Interest

The conference invites papers reporting on original research in AI testing and reports of the best practices in the industry, as well as the challenges in practice and research. Topics of interest include (but are not limited to) the following:

A. Testing AI applications:
-- Methodologies for testing, verification and validation of AI applications, such as:
·Process models for testing AI applications and quality assurance activities and procedures
·Quality models of AI applications and quality attributes of AI applications, such as correctness, reliability, safety, security, accuracy, precision, comprehensibility, explainability, etc., and testing for ensuring and assessing AI applications on various quality attributes.
·AI Testing, validation and verification in the whole lifecycle of AI applications, including analysis, design, development, deployment, operation and evolution
-- Techniques for testing AI applications, such as
· Test case design, test data generation, test prioritization, test reduction, etc.
· Metrics and measurements of the adequacy of testing AI applications;
· Test oracle for checking the correctness of AI application on test cases;
-- Automated Tools and environments for AI software Systems.
-- Specific concerns of software testing with various specific types of AI technologies, such as:
· Neural networks, statistical machine learning and data mining
· Symbolic machine learning, decision trees and random forests, reinforcement learning
· Evolutionary methods such as Genetic Algorithms
· Multi-agent systems
· Heuristic search algorithms
· Cognitive computing
· Knowledge management, expert systems
· Automatic reasoning and theorem proving
· Constraint Programming and Constraint Optimization
· Metaprogramming, high-order functions, high-order logic
· Programming by example, program synthesis, etc.
-- Specific concerns of software testing for various types of AI applications, such as
· Computer vision and object recognition in image, audio and video
· Virtual reality and augmented reality
· Computer games
· Personalized recommendation systems, and business intelligence
· Driverless vehicles and autonomous robotics
· Intelligent diagnostic systems
· Decision-making support systems
· Prediction and forecast systems
· Smart cities, smart home, healthcare, and medicine, etc.
· Natural language processing, and intelligent human machine interactions, etc.

B. Applications of AI techniques to software testing:
-- Machine learning applications to software testing, such as test case generation, test effectiveness prediction and optimization, test adequacy improvement, test cost reduction, etc.
-- Constraint Programming for test case generation and test suite reduction
-- Constraint Scheduling and Optimization for test case prioritization and test execution scheduling
-- Multi-agent systems for testing and test services
-- Crowdsourcing and swarm intelligence in software testing
-- Genetic algorithms, search-based techniques and heuristics to optimization of testing
-- Knowledge-based and expert systems for software testing

===================================================================================

Important Dates

Special Tracks proposals
Nov. 15, 2018

Abstract submission:
Dec. 7, 2018

Full paper submission:
Dec. 21, 2018 12:00 AOE (firm)

Notification:
Feb. 15, 2019 (firm)

Final Paper and Registration:
Feb. 28, 2019 (firm)

Conference:
Apr 4 - 9, 2019
===================================================================================

Paper Submission

We primarily invite submission of research papers, that describe original and significant work, but also papers which reports on case studies and empirical research.
Papers must not be accepted for publication, or be under submission to another conference or journal. Each paper will be reviewed by at least three members of the Program Committee, using a single-blind reviewing procedure.
All papers must be submitted electronically using the EasyChair conference system in PDF format. Each paper is limited to 8 pages including figures and references using IEEE Computer Society Proceedings (two columns, single-spaced, 10pt font).
At least one of the authors of any accepted paper would have to register for the conference and confirm that she/he will present the paper in person.

===================================================================================

Co-located Conferences

IEEE Mobile Cloud Conference 2019:
http://www.mobile-cloud.net//index.html

IEEE Big Data Service Conference 2019:
http://www.big-dataservice.net/index.html

IEEE System of Systems Engineering Conference 2019

IEEE Blockchain Conference 2019:
https://dappcon.net