教育经历

  • 2014-2019 清华大学计算机科学与技术系 博士
  • 2010-2014 清华大学计算机科学与技术系 本科

工作经历

  • 2024.09-至今 中国人民大学准聘副教授
  • 2022.09-2024.08 中国人民大学准聘助理教授
  • 2019.07-2022.08 腾讯微信模式识别中心 高级研究员

研究方向

预训练模型
自然语言处理

学生要求

具备较强的自主驱动能力,致力于开展具有较高创新性的研究工作,而非追求快速发表论文。

教授课程

  • 本科生课程:《知识表示与学习》
  • 研究生课程:《知识表示与推理》《预训练模型》

科研项目

  • 国自然面上项目《基于大规模预训练模型的工具学习研究》

学术论文

2023
PlugLM: Language Modeling with Plug-in Knowledge Memory.
Xin Cheng, Yankai Lin, Xiuying Chen, Dongyan Zhao and Rui Yan.
Findings of ACL 2023

Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning.
Weize Chen, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun and Jie Zhou.
Findings of ACL 2023

Recyclable Tuning for Continual Pre-training.
Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun and Jie Zhou.
Findings of ACL 2023

Emergent Modularity in Pre-trained Transformers.
Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Chaojun Xiao, Xiaozhi Wang, Xu Han, Zhiyuan Liu, Ruobing Xie, Maosong Sun and Jie Zhou.
Findings of ACL 2023

Plug-and-Play Knowledge Injection for Pre-trained Language Models.
Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Huadong Wang, Deming Ye, Chaojun Xiao, Xu Han, Zhiyuan Liu, Peng Li, Maosong Sun and Jie Zhou.
The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)

Plug-and-Play Document Modules for Pre-trained Models.
Chaojun Xiao, Zhengyan Zhang, Xu Han, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Xiangyang Li, Zhonghua Li, Zhao Cao and Maosong Sun.
The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)

Interactive Web Search for Chinese Long-form Question Answering
Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, Ruobing Xie, Fanchao Qi, Zhiyuan Liu, Maosong Sun and Jie Zhou
The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)

2022
On Length Divergence Bias in Textual Matching Models.
Lan Jiang, Tianshu Lyu, Yankai Lin, Meng Chong, Xiaoyong Lyu, Dawei Yin.
Findings of ACL 2022

Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach.
Xin Lv, Yankai Lin, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou.
Findings of ACL 2022

ELLE: Efficient Lifelong Pre-training for Emerging Data.
Yujia Qin, Jiajie Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.
Findings of ACL 2022.

MoEfication: Conditional Computation of Transformer Models for Efficient Inference.
Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.
Findings of ACL 2022

A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models.
Deming Ye, Yankai Lin, Peng Li, Maosong Sun, Zhiyuan Liu.
The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)

CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation.
Pei Ke, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Xiaoyan Zhu, Minlie Huang.
The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)

Packed Levitated Marker for Entity and Relation Extraction.
Deming Ye, Yankai Lin, Peng Li, Maosong Sun.
The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)

Fully Hyperbolic Neural Networks.
Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.
The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)

On Transferability of Prompt Tuning for Natural Language Processing.
Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou.
The 2022 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022)

Knowledge Inheritance for Pre-trained Language Models.
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.
The 2022 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022)

Rethinking the Promotion Brought by Contrastive Learning to Semi-supervised Node Classification.
Deli Chen, Yankai Lin, Lei Li, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun.
The 31st International Joint Conference on Artificial Intelligence (IJCAI-22)

Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models
Zichun Yu, Tianyu Gao, Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Maosong Sun, Jie Zhou.
The 29th International Conference on Computational Linguistics (COLING 2022)

Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Parameter-Efficient Tuning.
Jing Yi, Weize Chen, Yujia Qin, Yankai Lin, Ning Ding, Xu Han, Zhiyuan Liu, Maosong Sun, Jie Zhou.
Findings of EMNLP 2022

Exploring Mode Connectivity for Pre-trained Language Models.
Yujia Qin, Cheng Qian, Jing Yi, Weize Chen, Yankai Lin, Xu Han, Zhiyuan Liu, Maosong Sun, Jie Zhou.
The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)

MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction.
Xiaozhi Wang, Yulin Chen, Ning Ding, Hao Peng, Zimu Wang, Yankai Lin, Xu Han, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou.
The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)

ROSE: Robust Selective Fine-tuning for Pre-trained Language Models.
Lan Jiang, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Rui Jiang.
The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)

2021
Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information
Qiu Ran, Yankai Lin, Peng Li, Jie Zhou
Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021)

Aspect-Level Sentiment-Controllable Review Generation with Mutual Learning Framework
Huimin Chen, Yankai Lin, Fanchao Qi, Jinyi Hu, Peng Li, Jie Zhou, Maosong Sun
Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021)

TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference
Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun
2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT 2021)

CLEVE: Contrastive Pre-training for Event Extraction
Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li and Jie Zhou
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun and Jie Zhou
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction
Tianyu Gao, Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyu Xie, Yankai Lin , Zhiyuan Liu, Peng Li, Maosong Sun and Jie Zhou
Findings of ACL 2021

Rethinking Stealthiness of Backdoor Attack against NLP Models
Wenkai Yang, Yankai Lin , Peng Li, Jie Zhou and Xu Sun
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)

CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models
Yusheng Su, Xu Han, Zhengyan Zhang, Peng Li, Zhiyuan Liu, Yankai Lin, Jie Zhou, Maosong Sun
AI Open, 2021

MOOCCubeX: A Large Knowledge-centered Repository for Adaptive Learning in MOOCs
Jifan Yu, Yuquan Wang, Qingyang Zhong, Gan Luo, Yiming Mao, Kai Sun, Wenzheng Feng, Wei Xu, Shulin Cao, Kaisheng Zeng, Zijun Yao, Lei Hou, Yankai Lin , Peng Li, Jie Zhou, Bin Xu, Juanzi Li, Jie Tang and Maosong Sun
30th ACM International Conference on Information and Knowledge Management (CIKM 2021)

CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade
Lei Li, Yankai Lin , Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou and Xu Sun
Findings of EMNLP 2021

Dynamic Knowledge Distillation for Pre-trained Language Models
Lei Li, Yankai Lin , Shuhuai Ren, Peng Li, Jie Zhou and Xu Sun
The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)

CodRED: A Cross-Document Relation Extraction Dataset for Acquiring Knowledge in the Wild
Yuan Yao, Jiaju Du, Yankai Lin , Peng Li, Zhiyuan Liu, Jie Zhou and Maosong Sun
The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)

RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Wenkai Yang, Yankai Lin , Peng Li, Jie Zhou and Xu Sun
The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)

Topology-Imbalance Learning for Semi-Supervised Node Classification
Deli Chen, Yankai Lin , Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021)

Topology-Imbalance Learning for Semi-Supervised Node Classification.
Deli Chen, Yankai Lin , Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun.
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021)

2020
Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View
Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, Xu Sun
The 34th AAAI Conference on Artificial Intelligence (AAAI 2020)

Continual Relation Learning via Episodic Memory Activation and Reconsolidation
Xu Han, Yi Dai, Tianyu Gao, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)

Learning to Recover from Errors for Non-Autoregressive Neural Machine Translation
Qiu Ran*, Yankai Lin*, Peng Li*, Jie Zhou
The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)

More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction
Xu Han, Tianyu Gao, Yankai Lin, Hao Peng, Yaoliang Yang, Chaojun Xiao, Zhiyuan Liu, Peng Li, Jie Zhou and Maosong Sun
The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 9th International Joint Conference on Natural Language Processing (AACL-IJCNLP 2020)

Disentangle-based Continual Graph Representation Learning
Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li, Jie Zhou and Yan Zhang
The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)

MAVEN: A Massive General Domain Event Detection Dataset
Xiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang, Rong Han, Zhiyuan Liu, Juanzi Li, Peng Li, Yankai Lin and Jie Zhou
The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)

Learning from Context or Names? An Empirical Study on Neural Relation Extraction
Hao Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun and Jie Zhou
The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)

Coreferential Reasoning Learning for Language Representation
Deming Ye, Yankai Lin, Jiaju Du, Zhenghao Liu, Peng Li, Maosong Sun and Zhiyuan Liu
The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)

2019
XQA: A Cross-lingual Open-domain Question Answering Dataset
Jiahua Liu*, Yankai Lin*, Zhiyuan Liu, Maosong Sun
The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)

Fact Discovery from Knowledge Base via Facet Decomposition
Zihao Fu, Yankai Lin, Zhiyuan Liu, Wai Lam
The 2019 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2019)

DIAG-NRE: A Neural Pattern Diagnosis Framework for Distantly Supervised Neural Relation Extraction
Shun Zheng, Xu Han, Yankai Lin, Peilin Yu, Lu Chen, Ling Huang, Zhiyuan Liu, Wei Xu
The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)

Graph Neural Networks with Generated Parameters for Relation Extraction
Hao Zhu, Yankai Lin, Zhiyuan Liu, Jie Fu, Tat-Seng Chua, Maosong Sun
The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)

DocRED: A Large-Scale Document-Level Relation Extraction Dataset
Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun
The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)

NumNet: machine reading comprehension with numerical reasoning
Qiu Ran*, Yankai Lin*, Peng Li, Jie Zhou
The Conference on Empirical Methods in Natural Language Processing (EMNLP 2019)

2018
Improving Neural Fine-Grained Entity Typing with Knowledge Attention
Ji Xin, Yankai Lin, Zhiyuan Liu, Maosong Sun
The 32th AAAI Conference on Artificial Intelligence (AAAI 2018)

Denoising Distantly Supervised Open-Domain Question Answering
Yankai Lin, Haozhe Ji, Zhiyuan Liu, Maosong Sun
The 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018)

Adversarial Multi-lingual Neural Relation Extraction
Xiaozhi Wang, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun
The 27th International Conference on Computational Linguistics (COLING 2018)

Cross-lingual Lexical Sememe Prediction
Fanchao Qi*, Yankai Lin*, Maosong Sun, Hao Zhu, Ruobing Xie, Zhiyuan Liu
The Conference on Empirical Methods in Natural Language Processing (EMNLP 2018)

2017
Neural Relation Extraction with Multi-lingual Attention
Yankai Lin, Zhiyuan Liu, Maosong Sun
The 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017)

Recent Advances on Neural Headline Generation
Ayana, Shiqi Shen, Yankai Lin, Cunchao Tu, Yu Zhao, Zhiyuan Liu, Maosong Sun
Journal of Computer Science and Technology (JCST 2017)

Incorporating Relation Paths in Neural Relation Extraction
Wenyuan Zeng, Yankai Lin, Zhiyuan Liu, Maosong Sun
The Conference on Empirical Methods in Natural Language Processing (EMNLP 2017)

2016
Knowledge Representation Learning with Entities, Attributes and Relations
Yankai Lin, Zhiyuan Liu, Maosong Sun
International Joint Conference on Artificial Intelligence (IJCAI 2016)

Neural Relation Extraction with Selective Attention over Instances
Yankai Lin, Shiqi Shen, Zhiyuan Liu, Maosong Sun
The 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016)

Neural Sentiment Classification with User and Product Attention
Huimin Chen, Maosong Sun, Cunchao Tu, Yankai Lin and Zhiyuan Liu
The Conference on Empirical Methods in Natural Language Processing (EMNLP 2016)

Crossmodal language grounding, learning, and teaching
Stefan Heinrich, Cornelius Weber, Stefan Wermter, Ruobing Xie, Yankai Lin, Zhiyuan Liu
The 30th Conference on Neural Information Processing Systems (CoCo@NIPS'16)

2015
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, Xuan Zhu
The 29th AAAI Conference on Artificial Intelligence (AAAI 2015).

Modeling Relation Paths for Representation Learning of Knowledge Bases
Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, Song Liu
The Conference on Empirical Methods in Natural Language Processing (EMNLP 2015)

荣誉奖励

  • 2024 北京市科技新星计划
  • 2022 世界互联网领先科技成果《大规模知识图表示学习的体系化基础算法及开源工具》(第三完成人)
  • 2020 教育部自然科学一等奖 《结构化知识表示学习方法》(第三完成人)
  • 2019 北京市普通高等学校优秀毕业生 博士
  • 2018 百度奖学金

社会兼职

  • CCF NOI科学委员会委员
  • Frontier of Computer Science 青年编委
  • 北京智源 青源会会员
  • 中国中文信息学会 青工委委员

联系

电话:--

邮箱:yankailin@ruc.edu.cn

个人网页:https://linyankai.github.io/

办公地址:--