CRAC: NAACL Workshop on Computational Models of Reference, Anaphora, and Coreference - June 6th, 2018, New Orleans

Workshop description

Background There has been a lot of research activity in anaphora / coreference resolution in recent years, but once the DAARC series ended, there were no events in Computational Linguistics entirely dedicated to this type of work. The Coreference Beyond Ontonotes (CORBON) workshops held in 2016 (with NAACL) and 2017 (with EACL) partially addressed this need, but their focus was primarily on under-investigated coreference phenomena. The CRAC series of workshops is intended to be an event of interest to the entire anaphora / coreference / reference community.

Objectives The aim of the proposed workshop(s) is to provide a forum where work on all aspects of computational work on anaphora resolution and annotation, including both coreference and types of anaphora such as bridging references resolution and discourse deixis, can be presented. We also intend to attract work on reference (e.g., deictical reference to objects displayed in a multimodal interface).

Important dates

The important dates for CRAC are the same as for every other NAACL 2018 workhop:
  • Deadline for submissions: Extended to 9 March 2018 (11:59pm Hawaii Standard Time)
  • Notification of acceptance: 2 April 2018
  • Camera-ready version due: 16 April 2018
  • Workshop date: 6th June 2018

Data and Resources

The ARRAU corpus is distributed by LDC, that will make it available to the participants to this shared task. Participants should register for the shared task by email to Yulia Grishina ( and Massimo Poesio ( After registering, participants should download the Agreement form from this site, sign it, and send it to LDC, which will then release the data.


  • 9:00-9:10 Welcome (Massimo Poesio, Vincent Ng, Maciej Ogrodniczuk)
  • 9:10-10:30 Session 1
    • 9:10-10:00 Invited Talk: Ana Marasovic. Resolving Abstract Anaphors in Discourse — Uphill Battles with Neural Ranking Models and Automatic Data Extraction

      Abstract: Abstract anaphora resolution (AAR) is a challenging task that aims to resolve anaphoric reference of pronominal and nominal expressions that refer to abstract objects like facts, events, propositions, actions or situations, in the (typically) preceding discourse. A central property of abstract anaphora is that it establishes a relation between the anaphor embedded in the anaphoric sentence and its (typically non-nominal) antecedent. In this talk, I will present a mention-ranking model that learns how abstract anaphors relate to their antecedents with an LSTM-Siamese Net. I will describe how we harvested training data from a parsed corpus using a common syntactic pattern consisting of a verb with an embedded sentential argument. I will show results of the mention-ranking model trained for shell noun resolution and results on an abstract anaphora subset of the ARRAU corpus. The latter corpus presents a greater challenge due to a mixture of nominal and pronominal anaphors and a greater range of confounders. Finally, I will talk about ideas on how the training data extraction method and the mention-ranking model could be further improved for the challenges ahead.

    • 10:00-10:30, Berfin Aktaş, Tatjana Scheffler and Manfred Stede. Anaphora Resolution for Twitter Conversations: An Exploratory Study
  • 10:30-11:00 Coffee break
  • 11:00-12:30 Session 2: Shared Talk, Plural Reference
    • 11:00-11:30 Massimo Poesio, Yulia Grishina, Varada Kolhatkar, Nafise Moosavi, Ina Roesiger, Adam Roussel, Fabian Simonjetz, Alexandra Uma, Olga Uryupina, Juntao Yu and Heike Zinsmeister. Anaphora Resolution with the ARRAU Corpus
    • 11:30-12:00 Ina Roesiger. Rule and learning-based models for bridging resolution in the ARRAU corpus
    • 12:00-12:30 Amir Zeldes. A Predictive Model for Notional Anaphora in English.
  • 12:30-14:00 Lunch
  • 14:00-15:30 Session 3: Bridging, Discourse deixis, Anaphora in German, Corpus annotation 1.
    • 14:00-14:20 Ina Roesiger, Maximilian Köper, Kim Anh Nguyen and Sabine Schulte im Walde. Integrating Predictions from Neural-Network Relation Classifiers into Coreference and Bridging Resolution.
    • 14:20-14:50 Janis Pagel and Ina Roesiger. Towards Bridging Resolution in German: Data Analysis and Rule-based Experiments.
    • 14:50-15:10 Adam Roussel. Detecting and Resolving Shell Nouns in German.
    • 15:10-15:30 Anna Nedoluzhko, Michal Novák and Maciej Ogrodniczuk. PAWS: A Multi-lingual Parallel Treebank with Anaphoric Relations.
  • 15:30-16:00 Mid-afternoon snack
  • 16:00-17:30 Session 4: Corpus Annotation 2, Cognitive Models
    • 16:00-16:30 Michal Novák. A Fine-grained Large-scale Analysis of Coreference Projection.
    • 16:30-17:00 Jixing Li, Murielle Fabre, Wen-Ming Luh and John Hale. Modeling Brain Activity Associated with Pronoun Resolution in English and Chinese
    • 17:00-17:30 Sharid Loáiciga, Luca Bevacqua, Hannah Rohde and Christian Hardmeier. Event versus entity co-reference: Effects of context and form of referring expression.

Travel awards

A limited number of travel awards are available to student authors of accepted CRAC papers who are affiliated with U.S. institutions.


For all enquiries, please contact

Workshop Organizers


  • Massimo Poesio (Queen Mary University of London, UK)
  • Maciej Ogrodniczuk (Institute of Computer Science, Polish Academy of Sciences, Poland)
  • Vincent Ng (University of Texas at Dallas, USA)

Program committee:

  • Anders Bjorkelund, University of Stuttgart
  • Antonio Branco,  University of Lisbon
  • Dan Cristea, A. I. Cuza University of Iasi
  • Pascal Denis, MAGNET, INRIA Lille Nord-Europe
  • Sobha Lalitha Devi, AU-KBC Research Center, Anna University of Chennai
  • Yulia Grishina, University of Potsdam
  • Veronique Hoste, Ghent University
  • Ryu Iida, National Institute of Information and Communications Technology (NICT), Kyoto
  • Varada Kolhatkar, Simon Fraser University
  • Katja Markert, Heidelberg University
  • Costanza Navaretta, University of Copenhagen
  • Anna Nedoluzhko, Charles University in Prague
  • Michal Novak,  Charles University in Prague
  • Simone Paolo Ponzetto, University of Mannheim
  • Sameer Pradhan, and Boulder Learning Inc.
  • Marta Recasens, Google Inc.
  • Dan Roth, University of Pennsylvania.
  • Veselin Stoyanov, Facebook
  • Olga Uryupina, University of Trento
  • Yannick Versley, IBM
  • Sam Wiseman, Harvard University
  • Heike Zinsmeister, University of Hamburg

Shared Task

The proposed (series of( workshop(s) will be accompanied, like CORBON, by a shared task. The shared task(s) in 2018 will be on anaphora resolution using ARRAU (Uryupina et al, to appear), a corpus designed to

  • cover a more diverse range of genres than typical coreference corpora, including news, task-oriented dialogue, and narrative;
  • provide annotations for all noun phrases, including non-referring NPs and singletons (unlike in OntoNotes where only coreferential mentions are an- notated) and carefully annotated their boundaries catering also for non- continuous mentions;
  • include annotation of the full range of anaphoric phenomena, including bridging and discourse deixis;
  • include the annotation of a variety of morpho-syntactic and semantic attributes of mentions, including genericity.

For more details, see the shared task page .

Shared Task Organizers

  • Yulia Grishina, University of Potsdam (chair)
  • Varada Kolhatkar, Simon Fraser University
  • Anna Nedoluzhko, Charles University in Prague
  • Massimo Poesio, Queen Mary University of London
  • Adam Roussel, University of the Ruhr at Bochum
  • Fabian Simonjetz, University of the Ruhr at Bochum
  • Olga Uryupina, University of Trento
  • Heike Zinsmeister, University of Hamburg

Previous Events

  • CORBON '17
    CORBON 2017 was the 2nd edition of the workshop on Coreference Resolution Beyond OntoNotes, co-located with EACL 2017
  • CORBON '16
    CORBON 2017 was the 1st edition of the workshop on Coreference Resolution Beyond OntoNotes, co-located with NAACL 2016