Annual Meeting of the Association for Computational Linguistics (ACL)

ACL 2024   (August 11-16, 2024. Bangkok, Thailand.)
Best Paper:
Natural Language Satisfiability: Exploring the Problem Distribution and Evaluating Transformer-based Language Models
Tharindu Madusanka, Ian Pratt-Hartmann, Riza Batista-Navarro
[Source]
Deciphering Oracle Bone Language with Diffusion Models
Haisu Guan, Huanxin Yang, Xinyu Wang, Shengwei Han, Yongge Liu, Lianwen Jin, Xiang Bai, Yuliang Liu
[Source]
Mission: Impossible Language Models
Julie Kallini, Isabel Papadimitriou, Richard Futrell, Kyle Mahowald, Christopher Potts
[Source]
Semisupervised Neural Proto-Language Reconstruction
Liang Lu, Peirong Xie, David R. Mortensen
[Source]
Why are Sensitive Functions Hard for Transformers?
Michael Hahn, Mark Rofin
[Source]
Causal Estimation of Memorisation Profiles
Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel
[Source]
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model
Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, Wei-Yin Ko, Daniel D'souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker
[Source]
Best Social Impact Paper:
How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs
Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang, Ruoxi Jia, Weiyan Shi
[Source]
DIALECTBENCH: An NLP Benchmark for Dialects, Varieties, and Closely-Related Languages
Fahim Faisal, Orevaoghene Ahia, Aarohi Srivastava, Kabir Ahuja, David Chiang, Yulia Tsvetkov, Antonios Anastasopoulos
[Source]
Having Beer after Prayer? Measuring Cultural Bias in Large Language Models
Tarek Naous, Michael J. Ryan, Alan Ritter, Wei Xu
[Source]
Best Resource Paper:
Latxa: An Open Language Model and Evaluation Suite for Basque
Julen Etxaniz, Oscar Sainz, Naiara Perez, Itziar Aldabe, German Rigau, Eneko Agirre, Aitor Ormazabal, Mikel Artetxe, Aitor Soroa
[Source]
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Harsh Trivedi, Tushar Khot, Mareike Hartmann, Ruskin Manku, Vinty Dong, Edward Li, Shashank Gupta, Ashish Sabharwal, Niranjan Balasubramanian
[Source]
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo
[Source]
Best Theme Paper:
OLMo: Accelerating the Science of Language Models
Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
[Source]
Test of Time:
Measures of Distributional Similarities
Lillian Lee
[Source]
GloVe: Global Vectors for Word Representation
Jeffrey Pennington, Richard Socher, Christopher Manning
[Source]
ACL 2023   (July 9-14, 2023. Toronto, Canada.)
Best Paper:
Do Androids Laugh at Electric Sheep? Humor “Understanding” Benchmarks from The New Yorker Caption Contest
Jack Hessel, Ana Marasovic, Jena D. Hwang, Lillian Lee, Jeff Da, Rowan Zellers, Robert Mankoff, Yejin Choi
[Source]
From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models
Shangbin Feng, Chan Young Park, Yuhan Liu, Yulia Tsvetkov
[Source]
What the DAAM: Interpreting Stable Diffusion Using Cross Attention
Raphael Tang, Linqing Liu, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Pontus Stenetorp, Jimmy Lin, Ferhan Ture
[Source]
Best Theme Paper:
Weaker Than You Think: A Critical Look at Weakly Supervised Learning
Dawei Zhu, Xiaoyu Shen, Marius Mosbach, Andreas Stephan, Dietrich Klakow
[Source]
Best Resource Paper:
When Does Translation Require Context? A Data-driven, Multilingual Exploration
Patrick Fernandes, Kayo Yin, Emmy Liu, André Martins, Graham Neubig
[Source]
Best Reproduction Paper:
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?
Shuheng Liu, Alan Ritter
[Source]
Best Social Impact Paper:
Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models
Myra Cheng, Esin Durmus, Dan Jurafsky
[Source]
Most Cited Papers:
86
83
Unlearning bias in language models by partitioning gradients
C. Yu, S. Jeoung, A. Kasi, P. Yu, H. Ji
42
35
29
28
Structured pruning for efficient generative pre-trained language models
C. Tao, L. Hou, H. Bai, J. Wei, X. Jiang, Q. Liu
27
25
24
20
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2022   (May 22-27, 2022. Dublin, Ireland.)
Best Paper:
Learned Incremental Representations for Parsing
Nikita Kitaev, Thomas Lu, Dan Klein
[Source]
Best Theme Paper:
Requirements and Motivations of Low-Resource Speech Synthesis for Language Revitalization
Aidan Pine, Dan Wells, Nathan Brinklow, Patrick William Littell, Korin Richmond
[Source]
Best Resource Paper:
DiBiMT: A Novel Benchmark for Measuring Word Sense Disambiguation Biases in Machine Translation
Niccolò Campolungo, Federico Martelli, Francesco Saina, Roberto Navigli
[Source]
Best Linguistic Insight Paper:
KinyaBERT: a Morphology-aware Kinyarwanda Language Model
Antoine Nzeyimana, Andre Niyongabo Rubungo
[Source]
Outstanding Paper:
​Evaluating Factuality in Text Simplification
Ashwin Devaraj, William Berkeley Sheffield, Byron C. Wallace, Junyi Jessy Li
[Source]
Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue
Jiawei Zhou, Jason Eisner, Michael Newman, Emmanouil Antonios Platanios, Sam Thomson
[Source]
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation
Xiangpeng Wei, Heng Yu, Yue Hu, Rongxiang Weng, Weihua Luo, Rong Jin
[Source]
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Yao Lu, Max Bartolo, Alastair Moore, Sebastian Riedel, Pontus Stenetorp
[Source]
Inducing Positive Perspectives with Text Reframing
Caleb Ziems, Minzhi Li, Anthony Zhang, Diyi Yang
[Source]
Ditch the Gold Standard: Re-evaluating Conversational Question Answering
Huihan Li, Tianyu Gao, Manan Goenka, Danqi Chen
[Source]
Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons
Akash Kumar Mohankumar, Mitesh M. Khapra
[Source]
Compression of Generative Pre-trained Language Models via Quantization
Chaofan Tao, Lu Hou, Wei Zhang, Lifeng Shang, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong
[Source]
Most Cited Papers:
90
72
MINER: Multi-interest matching network for news recommendation
J. Li, J. Zhu, Q. Bi, G. Cai, L. Shang, Z. Dong
71
69
56
46
42
SemEval-2022 Task 8: Multilingual news article similarity
X. Chen, A. Zeynali, C.Q. Camargo, F. Flöck, D. Gaffney
41
37
35
Prompt-driven neural machine translation
Y. Li, Y. Yin, J. Li, Y. Zhang
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2021   (August 2-5, 2021. Online.)
Best Paper:
Vocabulary Learning via Optimal Transport for Neural Machine Translation
Jingjing Xu, Hao Zhou, Chun Gan, Zaixiang Zheng, Lei Li
[Source]
Best Theme Paper:
Including Signed Languages in Natural Language Processing
Kayo Yin, Amit Moryossef, Julie Hochgesang, Yoav Goldberg, Malihe Alikhani
[Source]
Outstanding Paper:
All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith
[Source]
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
Armen Aghajanyan, Sonal Gupta, Luke Zettlemoyer
[Source]
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering
Siddharth Karamcheti, Ranjay Krishna, Li Fei-Fei, Christopher Manning
[Source]
Neural Machine Translation with Monolingual Translation Memory
Deng Cai, Yan Wang, Huayang Li, Wai Lam, Lemao Liu
[Source]
Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers
Benjamin Marie, Atsushi Fujita, Raphael Rubino
[Source]
UnNatural Language Inference
Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams
[Source]
Most Cited Papers:
820
227
155
Multilingual translation from denoising pre-training
Y. Tang, C. Tran, X. Li, P.J. Chen, N. Goyal
138
105
104
92
90
89
87
Correcting Chinese spelling errors with phonetic pre-training
R. Zhang, C. Pang, C. Zhang, S. Wang, Z. He
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2020   (July 5-10, 2020. Online.)
Best Paper:
Beyond Accuracy: Behavioral Testing of NLP Models with CheckList
Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, Sameer Singh
[Source]
Best Theme Paper:
Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
Emily M. Bender, Alexander Koller
[Source]
Best Demonstration Paper:
GAIA: A Fine-grained Multimedia Knowledge Extraction System
Manling Li, Alireza Zareian, Ying Lin, Xiaoman Pan, Spencer Whitehead, Brian Chen, Bo Wu, Heng Ji, Shih-Fu Chang, Clare Voss, Daniel Napierski, Marjorie Freedman
[Source]
Most Cited Papers:
1160
Beyond accuracy: Behavioral testing of NLP models with CheckList
M.T. Ribeiro, T. Wu, C. Guestrin, S. Singh
272
ParaCrawl: Web-scale acquisition of parallel corpora
M. Bañón, P. Chen, B. Haddow, K. Heafield, H. Hoang
198
135
107
COVID-QA: A question answering dataset for COVID-19
T. Möller, A. Reina, R. Jayakumar
81
79
72
58
47
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2019   (July 28 - August 2, 2019. Florence, Italy.)
Best Short Paper:
Do you know that Florence is packed with visitors? Evaluating state-of-the-art models of speaker commitment
Nanjiang Jiang, Marie-Catherine de Marneffe
[Source]
Best Long Paper:
Bridging the Gap between Training and Inference for Neural Machine Translation
Wen Zhang, Yang Feng, Fandong Meng, Di You Qun Liu
[Source]
Outstanding Paper:
Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Texts
Rui Xia, Zixiang Ding
[Source]
A Simple Theoretical Model of Importance for Summarization
Maxime Peyrard
[Source]
Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systems
Chien-Sheng Wu, Andrea Madotto, Ehsan Hosseini-Asl, Caiming Xiong, Richard Socher, Pascale Fung
[Source]
We need to talk about standard splits
Kyle Gorman, Steven Bedrick
[Source]
Zero-shot Word Sense Disambiguation using Sense Definition Embeddings
Sawan Kumar, Sharmistha Jat, Karan Saxena, Partha Talukdar
[Source]
Best Demonstration Paper:
OpenKiwi: An Open Source Framework for Quality Estimation
Fabio Kepler, Jonay Trenous, Marcos Treviso, Miguel Vera, André F. T. Martins
[Source]
Most Cited Papers:
1589
774
Findings of the 2019 conference on machine translation (WMT19)
L. Barrault, O. Bojar, M.R. Costa-Jussa, C. Federmann
142
124
101
73
70
64
59
52
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2018   (July 15-20, 2018. Melbourne, Australia.)
Best Short Paper:
Know What You Don’t Know: Unanswerable Questions for SQuAD
Pranav Rajpurkar, Robin Jia, Percy Liang
[Source]
‘Lighter’ Can Still Be Dark: Modeling Comparative Color Descriptions
Olivia Winn, Smaranda Muresan
[Source]
Best Long Paper:
Finding syntax in human encephalography with beam search
John Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan Brennan
[Source]
Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Information
Sudha Rao, Hal Daumé III
[Source]
Let’s do it “again”: A First Computational Approach to Detecting Adverbial Presupposition Triggers
Andre Cianflone, Yulan Feng, Jad Kabbara, Jackie Chi Kit Cheung
[Source]
Best System Demonstration Paper:
Out-of-the-box Universal Romanization Tool uroman
Ulf Hermjakob, Jonathan May, Kevin Knight
[Source]
Most Cited Papers:
240
Deeppavlov: Open-source library for dialogue systems
M. Burtsev, A. Seliverstov, R. Airapetyan
235
217
162
119
114
109
94
88
69
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2017   (July 30 - August 4, 2017. Vancouver, Canada.)
Best Paper:
Probabilistic Typology: Deep Generative Models of Vowel Inventories
Ryan Cotterell, Jason Eisner
[Source]
Most Cited Papers:
578
Creating training corpora for nlg micro-planning
C. Gardent, A. Shimorina, S. Narayan
503
498
Superagent: A customer service chatbot for e-commerce websites
L. Cui, S. Huang, F. Wei, C. Tan, C. Duan
436
The WebNLG challenge: Generating text from RDF data
C. Gardent, A. Shimorina, S. Narayan
274
210
198
Hafez: an interactive poetry generation system
M. Ghazvininejad, X. Shi, J. Priyadarshi
156
Social bias in elicited natural language inferences
R. Rudinger, C. May, B. Van Durme
133
Varying linguistic purposes of emoji in (Twitter) context
N. Na'aman, H. Provenza, O. Montoya
121
(number of citations according to Google Scholar [source], last updated: 01/17/25)
ACL 2015   (July 26-31, 2015. Beijing, China.)
Best Paper:
Improving Evaluation of Machine Translation Quality Estimation
Yvette Graham
[Source]
Learning Dynamic Feature Selection for Fast Sequential Prediction
Emma Strubell, Luke Vilnis, Kate Silverstein, Andrew McCallum
[Source]
Most Cited Papers:
894
266
180
149
Multi-level translation quality prediction with quest++
L. Specia, G. Paetzold, C. Scarton
114
93
87
85
Semeval-2015 task 8: Spaceeval
J. Pustejovsky, P. Kordjamshidi, M.F. Moens
83
79
(number of citations according to Google Scholar [source], last updated: 01/17/25)