DALI: Disagreements and Language Interpretation

Publications

2021

Stay Together: A System for Single and Split-antecedent Anaphora Resolution
Juntao Yu, Nafise Sadat Moosavi, Silviu Paun and Massimo Poesio

Proceedings of the 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)

Beyond Black & White: Leveraging Annotator Disagreement via Soft-Label Multi-Task Learning
Tommaso Fornaciari, Alexandra Uma, Silviu Paun, Barbara Plank, Dirk Hovy, Massimo Poesio

Proceedings of the 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)

Processing of discourse anaphors by Turkish L2 speakers of English
Çokal, D., Sturt, P., & Ferreira, F.

Dialogue and Discourse

Relations between intentionality, theory of mind, and complex syntax in autism spectrum conditions and typical development
Schroeder, K., Durrleman, S., Çokal, D., Delgado, S.A., Marin, A.M., & Hinzen, W

Cognitive Development,59, 101701

Set-subset effect on the processing of plurals. An Italian network of experimental pragmatics
Çokal, D., & Poesio, M

XPRAG.it, 16-17 July, Italy

Underspecification in processing of plurals
Çokal, D., & Poesio, M.

The acquisition and processing of reference and anaphora resolution (APRAR), September 1-2, Brussels.

Patterns of Polysemy and Homonymy in Contextualised Language Models
Janosch Haber, Massimo Poesio

ACL

2020

Aggregation Driven Progression System for GWAPs
D. Kicikoglu, R. Bartle, J. Chamberlain, S. Paun and M. Poesio

Workshop on Games and Natural Language Processing

Classification of Low-Agreement Pronouns Through Collaborative Dialogue: A Proof of Concept
Janosch Haber and Massimo Poesio

Proceedings of the 24th Workshop on the Semantics and Pragmatics of Dialogue

Neural Mention Detection
Juntao Yu, Bernd Bohnet, Massimo Poesio

Proceedings of the 12th Language Resources and Evaluation Conference (LREC), 2020

A Cluster Ranking Model for Full Anaphora Resolution
Juntao Yu, Alexandra Uma and Massimo Poesio

Proceedings of the 12th Language Resources and Evaluation Conference (LREC), 2020

Named Entity Recognition as Dependency Parsing
Juntao Yu, Bernd Bohnet, Massimo Poesio

Proceedings of the 58th Annual Conference of the Association for Computational Linguistics (ACL), 2020

Free the Plural: Unrestricted Split-Antecedent Anaphora Resolution
Juntao Yu, Nafise Sadat Moosavi, Silviu Paun and Massimo Poesio

Proceedings of he 28th International Conference on Computational Linguistics (COLING), 2020

Multi-task Learning Based Neural Bridging Reference Resolution
Juntao Yu and Massimo Poesio

Proceedings of he 28th International Conference on Computational Linguistics (COLING), 2020

Word Sense Distance in Human Similarity Judgements and Contextualised Word Embeddings
Janosch Haber and Massimo Poesio

Proceedings of the Probability and Meaning Conference (PaM 2020), Association for Computational Linguistics

Neural Coreference Resolution for Arabic
Abdulrahman Aloraini, Juntao Yu and Massimo Poesio

Proceedings of the Third Workshop on Computational Models of Reference, Anaphora and Coreference (CRAC@COLING)

Assessing Polyseme Sense Similarity through Co-predication Acceptability and Contextualised Embedding Distance
Janosch Haber and Massimo Poesio

Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics

A Case for Soft Loss Functions
Alexandra Uma, Tommaso Fornaciari, Dirk Hovy, Silviu Paun, Barbara Plank, Massimo Poesio

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing

Processing of plural pronouns in set-subset context
Çokal, D., & Poesio, M

Poster at the 21st Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP), University of Potsdam, 3-5 September, Germany

2019

A Crowdsourced Corpus of Multiple Judgments and Disagreement on Anaphoric Interpretation
M. Poesio, J. Chamberlain, U. Kruschwitz, S. Paun, A. Uma and J. Yu

Proc. of NAACL

Making Text Annotation Fun with a Clicker Game
C. Madge, R. Bartle, J. Yu, J. Chamberlain, U. Kruschwitz and M. Poesio

Fourth Games and Natural Language Processing Workshop (GAMNLP-19)

Crowdsourcing and Aggregating Nested Markable Annotations
C. Madge, J. Yu, J. Chamberlain, U. Kruschwitz, S. Paun and M. Poesio

ACL 2019. The 57th Annual Meeting of the Association for Computational Linguistics (ACL)

Wormingo: A "True Gamification" Approach to Anaphoric Annotation
D. Kicikoglu, R. Bartle, J. Chamberlain and M. Poesio, 2019

Fourth Games and Natural Language Processing Workshop (GAMNLP-19)

The PhotoBook Dataset: Building Common Ground through Visually-Grounded Dialogue
J. Haber, T. Baumgartner, E. Takmaz, L. Gelderloos, E. Bruni and R. Fernandez

Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL), 2019

The Design Of A Clicker Game for Text Labelling
C. Madge, R. Bartle, J. Yu, J. Chamberlain, U. Kruschwitz and M. Poesio, 2019

IEEE CoG 2019

Using Automatically Extracted Minimum Spans to Disentangle Coreference Evaluation from Boundary Detection
N. Moosavi, L. Born, M. Poesio, M. Strube, 2019

Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics

Incremental Game Mechanics Applied to Text Annotation
C. Madge, R. Bartle, J. Chamberlain, U. Kruschwitz and M. Poesio

CHI PLAY '19 Proceedings of the Annual Symposium on Computer-Human Interaction in Play Pages 545-558

Progression in a Language Annotation Game with a Purpose
C. Madge, J. Yu, J. Chamberlain, U. Kruschwitz, S. Paun and M. Poesio

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing

2018

Optimising Crowdsourcing Efficiency: Amplifying Human Computation with Validation
J. Chamberlain, U. Kruschwitz and M. Poesio

it-Information Technology

Annotating a broad range of anaphoric phenomena, in a variety of genres: the ARRAU corpus
O. Uryupina, R. Artstein, A. Bristot, F. Cavicchio, F. Delogu and K. Rodriguez

Journal of Natural Language Engineering

Comparing Bayesian Models of Annotation
Paun, S. and Carpenter, B. and Chamberlain, J. and Hovy, D. and Kruschwitz, U. and Poesio, M., 2018

Transactions of the ACL

A probabilistic annotation model for crowdsourcing coreference
S. Paun, J. Chamberlain, U. Kruschwitz, J. Yu and M.Poesio, 2018

Proc. of EMNLP

Anaphora Resolution with the ARRAU Corpus
M. Poesio., Y. Grishina, V. Kolhatkar, N. Moosavi, I. Roesiger, A. Roussel, F. Simonjetz, A. Uma, O. Uryupina, J. Yuz and H. Zinsmeister, 2018

Proc. of the NAACL Worskhop on Computational Models of Reference, Anaphora and Coreference (CRAC)

2017

Experiment-Driven Development of a GWAP for Marking Segments in Text
C. Madge, J. Chamberlain, U. Kruschwitz and M. Poesio, 2017

Proc. of CHI PLAY

Testing game mechanics in games with a purpose for NLP applications
C. Madge, U. Kruschwitz, J. Chamberlain, R. Bartle and M. Poesio, 2017

Proc. Games4NLP symposium, Valencia

Metrics of games-with-a-purpose for NLP applications
J. Chamberlain, R. Bartle, U. Kruschwitz, C. Madge and M. Poesio, 2017

Proc. Games4NLP symposium, Valencia

Publications Before DALI Launch

2016

Phrase Detectives Corpus 1.0 Crowdsourced Anaphoric Coreference
J. Chamberlain, M. Poesio and U. Kruschwitz, 2016
Dataset is available on request, please contact jchamb@essex.ac.uk

Proc. LREC16, Portoroz

Novel Incentives for Phrase Detective
M. Poesio, J. Chamberlain, U. Kruschwitz and C. Madge, 2016

Proc. LREC16, Portoroz

2015

Phrase Detectives: Utilizing collective intelligence for internet-scale language resource creation (extended abstract)
M. Poesio, J. Chamberlain, U. Kruschwitz, L. Robaldo and L. Ducceschi, 2015

Proc. IJCAI15, Buenos Aires

2014

User Performance Indicators In Task-Based Data Collection Systems
J. Chamberlain and C. O'Reilly, 2014

Proc. MindTheGap'14, Berlin.

Methods for Engaging and Evaluating Users of Human Computation Systems
J. Chamberlain, U. Kruschwitz and M. Poesio, 2014

Handbook of Human Computation (Springer)

The Annotation-Validation (AV) Model: Rewarding Contribution Using Retrospective Agreement
J. Chamberlain, 2014

Proc. GamifIR'14, Amsterdam.

2013

Using Games to Create Language Resources: Successes and Limitations of the Approach
J. Chamberlain, K. Fort, U. Kruschwitz, M. Lafourcade and M. Poesio, 2013

The People's Web Meets NLP, 3-44 (Springer)

Phrase Detectives: Utilizing Collective Intelligence for Internet-Scale Language Resource Creation
M. Poesio, J. Chamberlain, U. Kruschwitz, L. Robaldo and L. Ducceschi, 2013.

ACM Transactions on Interactive Intelligent Systems (TiiS) 3(1), 3.

2012

Motivations for Participation in Socially Networked Collective Intelligence Systems
J. Chamberlain, U. Kruschwitz and M. Poesio, 2012.

Proc. CI2012, Boston.

The Phrase Detective Multilingual Corpus, Release 0.1
M. Poesio, J. Chamberlain, U. Kruschwitz, L. Robaldo and L. Ducceschi, 2012.

Proc. LREC2012 Istanbul

2011

Italian Anaphoric Annotation with the Phrase Detectives Game-With-A-Purpose
L. Robaldo, M. Poesio, L. Ducceschi, J. Chamberlain and U. Kruschwitz, 2011

AI*IA 2011: Artificial Intelligence Around Man and Beyond, pp407-412.

2008

Phrase Detectives: A Web-based collaborative annotation game
J. Chamberlain, M. Poesio and U. Kruschwitz, 2008

Proc. iSemantics., Graz.