Recently, artificial intelligence has seen the explosion of deep learning models, which are able to reach super-human performance in several tasks, finding application in many domains. These performance improvements, however, come at a cost: DL models are uninterpretable black boxes, where one feeds an input and obtains an output without understanding the motivations behind that prediction or decision.
To address this problem, two research areas are particularly active: the eXplainable AI (XAI) field and the visual analytics community. The eXplainable XAI field tries to address such problems by proposing algorithmic methods that can explain, at least partially, the behavior of these networks. Their works also try to define the limits of interpretability, the definition of valid metrics, the study of users, and the study of the effectiveness of these solutions. Conversely, visual analytics systems target users helping them to understand and interact with machine learning models providing visualizations and systems that facilitate the exploration, analysis, interaction, and understanding of machine learning models. In the last few years, the usage of methodologies that explain deep learning models has become central in these systems. As a result, the interaction between the XAI and visual analytics communities is becoming more and more important.
The workshop aims at advancing the discourse by collecting novel methods and discussing challenges, issues, and goals around the usage of XAI approaches to debug and improve current deep learning models. To achieve this goal, the workshop aims at bringing researchers and practitioners from both fields, strengthening their collaboration. In particular, we narrow the XAI focus to the specific case in which developers or researchers need to debug their models and diagnose system behaviors. Therefore we start from the assumption that this type of user typically has substantial knowledge about the models themselves but needs to validate, debug, and improve them. The workshop is scheduled for December 14, 2021.
The topics include but are not limited to:
- Novel XAI methods (post-hoc, ante-hoc, model-agnostic, etc.): note that these methods should be applicable to deep learning models, but their scope also can be different from debugging or diagnosis;
- Interpretable/Explainable deep learning models;
- Applications and protocols that use current XAI methods to improve and/or debug deep learning models;
- XAI evaluation: how can we assess the quality of explanations and their effectiveness for debugging purposes?
- User studies that include developers
- Qualitative analysis of XAI techniques
- Visualization techniques for debugging Deep Learning models;
- Debugging via interpretability: How can explainable artificial intelligence help us in debugging deep learning models?
- XAI methods to identify and address sources and causes of failure (e.g.training data, regularization, objective functions, etc.);
- Visual analytics systems for understanding and debugging deep learning models;
- Visual analytics systems guided by XAI methods - where XAI methods are the core of the system;
- Analysis of limitations of current XAI approaches;
- Position papers on the topic of the workshop.
Call for Papers
The call for papers includes three different tracks: regular, mentorship, and a glimpse of the future track. The first one is the traditional track for presenting novel contributions. The second one is directed to young researchers and aims to pair a mentor and a mentee with the goal of polishing early-submissions. The last one is intended for first-year PhD students and MSc students working on the topic, giving them the possibility to introduce themselves and their research proposal to the research community.
Submissions to this track have to be novel contributions covering any topic listed above. We don’t accept work that has been already published, that is concurrently submitted to other venues before the submission deadline, or that is presented at the main NeurIPS conference, including as part of an invited talk. We solicit submission of full papers, position papers, and papers describing open problems on one of the topics listed above. Papers must be submitted through the Open Review submission system. Papers submitted to the workshop can be submitted to future conferences (e.g. ICML, ICLR) if the acceptance notification comes after the workshop date (December, 14).
We only allow dual submissions of papers submitted to the main NeurIPS 2021 conference with the following constraints: papers must be withdrawn from this workshop before October 1st if they will be accepted at the main conference; papers must include the declaration of dual submission BEFORE the introduction section; authors must append the reviews received from NeurIPS conference (printed from the OpenReview system) to the main corpus and a brief letter summarizing the improvements made after the review process.
We encourage the authors to link a anonymized repository containing the code to replicate the results inside the corpus of the paper. While this is not a mandatory requirement, it will be positively taken in account during the reviewing process and the selection of the contributed talks. You can use Anonymous Github or you can upload your repository on a service that allows anonymity (e.g. GDrive allows anonymous links).
Submissions must follow the NeurIPS anonymized paper format (see NeurIPS style files), and they are limited to a maximum of 9 pages, excluding references. Shorter papers are welcome. They will undergo double-blind peer review. Authors may append to the paper supplementary material, such as appendices, proofs, and derivations; Like submissions, supplementary material must be anonymized. Looking at supplementary material is at the discretion of the reviewers.
At the end of your paper submission, please indicate whether you would like an extended version of the submission to be considered for publication in a journal special issue. According to the feedback from authors, we will further decide whether to publish selected high-quality papers in proceedings or a journal special issue. Reviewers will nominate papers among them with exemplary scientific rigor for publication. We will ask authors again after the acceptance of the paper whether you would like to proceed to a journal special issue. Note that in this case there can be restrictions regarding dual submissions with future conference, depending on the policy of the chosen journal.
Accepted works will be presented as contributed talks or as posters in a poster session or listed on the workshop site as accepted contributions, depending on schedule constraints. It is mandatory that at least one of the authors will attend the workshop and present its work during the contributed talks and the poster session. We are planning to include an additional virtual channel, like Slack, where each accepted paper will have a dedicated section for attendance and authors to discuss. We strongly encourage authors to be available on their section before, during, and shortly after the workshop.
Important Dates for Regular Track:
Submission system opens: 11:59 PM CEST, Aug 15, 2021 LINK Submission deadline: 11:59 PM CEST, Sep 20, 2021 (Extended deadline!)
Notification date: 11:59 PM CEST,
Oct 10 Oct 15, 2021
Camera-ready deadline: 11:59 PM CEST, Oct 20, 2021
SlidesLive upload for speaker videos: 11:59 PM CEST, Oct 25, 2021
Workshop date: Dec 14, 2021
The mentorship track pairs authors with experienced researchers who have committed to providing meaningful feedback to help polish papers for general submission. This program helps authors to get support and fast feedback from the research community, by facilitating a private dialogue between the mentee and mentor. The papers of this track have to be non-anonymous, template-free. Note that the goal of this track is to receive fast feedback about the structure of the paper and to polish it. It is not intended for deep review. None of the papers submitted to this track will be presented or included in the workshop schedule.
Important Dates for Mentorship track:
Submission deadline: 11:59 PM CEST, Sep 30, 2021 LINK
A glimpse of the future track:
This special track aims at discovering and highlighting the most promising students in the field. The students will have the possibility to present their research plan to the community, describing the problems that they plan to address and possible research directions. Submissions for this track must include a research plan (max. 2 pages) and a cover letter from the current or future supervisor. The plan should briefly highlight the problem that the researcher will try to attack, the current methodologies and the expected outcome of its research agenda. This track is intended for first-year PhD students or prospective PhD students. The accepted students will present their plans during the workshop in a dedicated talk. We plan to accept at least 2 students as oral presentations.
Important Dates for A glimpse of the future track:
Submission deadline: 11:59 PM CEST, Sep 20, 2021 LINK
Notification Date: 11:59 PM CEST, Oct 10, 2021
SlidesLive upload for speaker videos: 11:59 PM CEST, Oct 25, 2021
Peter Stone (Sony AI) and Daniele Nardi (Sapienza University of Rome)
- Adam Perer, Carnegie Mellon University
- Ana Lucic, University of Amsterdam
- Amirata Ghorbani, Stanford University
- Arjun Akula, University of California
- Avishek Anand, Leibniz University
- Bilal Alsallakh, Facebook
- Chaofan Chen, University of Maine
- Chirag Agarwal, Harvard University
- Christopher J. Anders, Technical University of Berlin
- Daniele Nardi, Sapienza University of Rome
- Damien Garreau, Universite Cote d’Azur
- Eoin M. Kenny, Insight Centre for Data Analytics
- Eunji Kim, Seoul National University
- Francesca Rossi, IBM
- Giuseppe Santucci, Sapienza University of Rome
- Gregory Plumb, Carnegie Mellon University
- Hanjie Chen, University of Virginia
- Jaesik Choi, KAIST
- James Wexler, Google
- Jesse Vig, Salesforce
- Jie Ren, Shanghai Jiao Tong University
- José Oramas, University of Antwerp
- Lev Utkin, Peter the Great St.Petersburg Polytechnic University
- Marco Angelini, Sapienza University of Rome
- Marco Valentino, University of Manchester
- Mark Keane, University College Dublin
- Pepa Atanasova, University of Copenhagen
- Przemyslaw Biecek, Warsaw University of Technology
- Riccardo Guidotti, University of Pisa
- Rosina Weber, Drexel University
- Sameer Singh, University of California
- Sandareka Wickramanayake, National University of Singapore
- Scott Cheng-Hsin Yang, Rutgers University
- Shivansh Patel, University of Illinois
- Seojin Bang, Carnegie Mellon University
- Sijia Liu, Michigan State University
- Suryabhan Singh Hada, University of California
- Tong Wang, University of Iowa
- Tongshuang Wu, University of Washington
- Umang Bhatt, University of Cambridge
- Ute Schmid, University of Bamberg
- Vitali Petsiuk, Boston University
- Wenbo Guo, Pennsylvania State University
- Wojciech Samek, Fraunhofer HHI
- Wolfgang Stammer, Technical University Darmstadt
- Woo-Jeoung Nam, Korea University
- Yunfeng Zhang, IBM
If you have any questions feel free to join our slack channel or contact us at any of the following email addresses:
- larosa AT diag.uniroma1.it
- capobianco AT diag.uniroma1.it
- afeldman AT parc.com
- lgilpin AT ucsc.edu