Semiparametric Methods in NLP:
Decoupling Logic from Knowledge

Workshop at ACL 2022
May 27th, 2022 (hybrid)
Contact: organizers@semiparametric.ml

Archival Papers

Efficient Machine Translation Domain Adaptation
Pedro Henrique Martins, Zita Marinho, Andre Martins

Improving Discriminative Learning for Zero-Shot Relation Extraction
Van-Hien Tran, Hiroki Ouchi, Taro Watanabe, Yuji Matsumoto

Choose Your QA Model Wisely: A Systematic Study of Generative and Extractive Readers for Question Answering
Man Luo, Kazuma Hashimoto, Semih Yavuz, Zhiwei Liu, Chitta Baral, Yingbo Zhou

Field Extraction from Forms with Unlabeled Data
Mingfei Gao, Zeyuan Chen, Nikhil Naik, Kazuma Hashimoto, Caiming Xiong, Ran Xu

Knowledge Base Index Compression via Dimensionality and Precision Reduction
Vilém Zouhar, Marius Mosbach, Miaoran Zhang, Dietrich Klakow

Non-Archival Papers

A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models
Da Yin, Li Dong, Hao Cheng, Xiaodong Liu, Kai-Wei Chang, Furu Wei, Jianfeng Gao

KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier
Linyang Li, Demin Song, Ruotian Ma, Xipeng Qiu, Xuanjing Huang

Learning to Retrieve Passages without Supervision
Ori Ram,Gal Shachaf,Omer Levy,Jonathan Berant,Amir Globerson

Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering
Jiawei Zhou, Xiaoguang, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen

Towards Continual Knowledge Learning of Language Models
Joel Jang, Seonghyeon Ye, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, Stanley Jungkyu Choi, Minjoon Seo

Learning Cross-Lingual IR from an English Retriever
Yulong Li, Martin Franz, Md Arafat Sultan, Bhavani Iyer, Young-Suk Lee, Avirup Sil

C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References
Xiang Yue, Xiaoman Pan, Wenlin Yao, Dian Yu, Dong Yu, Jianshu Chen

Towards Unsupervised Dense Information Retrieval with Contrastive Learning
Gautier Izacard, Mathilde Caron, Lucas Hosseini, Sebastian Riedel, Piotr Bojanowski, Armand Joulin, Edouard Grave

Internet-augmented language models through few-shot prompting for open-domain question answering
Anonymous

Towards Interactive Language Modeling
Maartje ter Hoeve, Evgeny Kharitonov, Dieuwke Hupkes, Emmanuel Dupoux

GUD-IR: Generative Retrieval for Semiparametric Models
Aman Madaan, Niket Tandon, Peter Clark, Yiming Yang

Less is More: Summary of Long Instructions is Better for Program Synthesis
Kirby Kuznia, Swaroop Mishra, Mihir Parmar, Chitta Baral

How Many Data Samples is an Additional Instruction Worth?
Ravsehaj Singh Puri, Swaroop Mishra, Mihir Parmar, Chitta Baral

Is Retriever Merely an Approximator of Reader?
Sohee Yang, Minjoon Seo

TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
Joel Jang, Seonghyeon ye, Changho Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, Minjoon Seo

Unsupervised Cross-Task Generalization via Retrieval Augmentation
Bill Yuchen Lin, Kangmin Tan, Chris Scott Miller, Beiwen Tian, Xiang Ren

Controllable Semantic Parsing via Retrieval Augmentation
Panupong Pasupat, Yuan Zhang, Kelvin Guu

StreamingQA: A Benchmark for Adaptation to New Knowledge over Timein Question Answering Models
Adam Liska, Tomas Kocisky, Elena Gribovskaya, Tayfun Terzi, Eren Sezener, Devang Agrawal, Cyprien de Masson d’Autume, Tim Scholtes, Manzil Zaheer, Susannah Young, Ellen Gilsenan-McMahon, Sophia Austin, Phil Blunsom, Angeliki Lazaridou

On the Effect of Pretraining Corpora on In-context Few-shot Learning by a Large-scale Language Model
Seongjin Shin, Sang-Woo Lee, Hwijeen Ahn, Sungdong Kim, HyoungSeok Kim, Boseop Kim, Kyunghyun Cho, Gichang Lee, Woomyoung Park, Jung-Woo Ha, Nako Sung

Exploring Dual Encoder Architectures for Question Answering
Zhe Dong, Jianmo Ni, Daniel M. Bikel, Enrique Alfonseca, Yuan Wang, Chen Qu, Imed Zitouni

RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing
Vivek Gupta, Akshat Shrivastava, Adithya Sagar, Armen Aghajanyan, Denis Savenkov

PERKGQA: Question Answering over Personalized Knowledge Graphs
Ritam Dutt, Kasturi Bhattacharjee, Rashmi Gangadharaiah, Dan Roth, Carolyn Penstein Rosé

Learning To Retrieve Prompts for In-Context Learning
Ohad Rubin, Jonathan Herzig, Jonathan Berant