Education

  • 2016-2021, Ph.D. Department of physics, Renmin University of China. Tutor：Zhong-Yi Lu Professor
  • 2012-2016, B.E. Department of physics, Renmin University of China.

Work Experience

  • 2021.9-Present, Renmin University of China, Postdoctor. Cooperative tutor: Ji-Rong Wen Professor

RESEARCH INTERESTS

Model compression, data compression and pre-training language model based on tensor network

Research Projects

National Natural Science Foundation of China, general project, research on some problems in quantum impurity system based on natural orbital renormalization group, participated in theoretical derivation and numerical analysis
Beijing Natural Science Foundation, key research topic, research on ion trap quantum computing technology and algorithm, participated in programming, design and analysis

PUBLICATIONS

2024
Enhancing Parameter-efficient Fine-tuning with Simple Calibration Based on Stable Rank
Peiyu Liu, Ze-Feng Gao, Xiao Zhang, Wayne Xin Zhao, Ji-Rong Wen
COLING2024
Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KY Cache Compression.
Peiyu Liu, Ze-Feng Gao, Wayne Xin Zhao, Yipeng Ma, Tao Wang, Ji-Rong Wen.
ACL2024
Extremely strong spin-orbit coupling effect in light element altermagnetic materials
Shuai Qu, Ze-Feng Gao, Hao Sun, Kai Liu, Peng-Jie Guo, Zhong-Yi Lu
Arxiv
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
Peiyu Liu, Zikang Liu, Ze-Feng Gao, Dawei Gao, Wayne Xin Zhao, Yaliang Li, Bolin Ding, Ji-Rong Wen
COLING2024
2023
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing
Peiyu Liu, Ze-Feng Gao, Yushuo Chen, Xin Zhao, Ji-Rong Wen
EMNLP2023
AI-accelerated Discovery of Altermagnetic Materials
Ze-Feng Gao, Shuai Qu, Bocheng Zeng, Yang Liu, Ji-Rong Wen, Hao Sun, Peng-Jie Guo, Zhong-Yi Lu
Arxiv
Altermagnetic ferroelectric LiFe2F6 and spin-triplet excitonic insulator phase
Peng-Jie Guo, Yuhao Gu, Ze-Feng Gao, Zhong-Yi Lu
Arxiv
Matrix Product Operator based Sequential Recommendation Model
Peiyu Liu, Bowen Yao, Ze-Feng Gao*, Wayne Xin Zhao*
CCIR2023
Compression Image Dataset Based on Multiple Matrix Product States
Ze-Feng Gao, Peiyu Liu, Wayne Xin Zhao, Zhi-Yuan Xie, Ji-Rong Wen and Zhong-Yi Lu
FICC2024
Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture
Peiyu Liu*, Ze-Feng Gao*, Wayne Xin Zhao, Ji-Rong Wen
EMNLP2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
Ze-Feng Gao, Kun Zhou, Peiyu Liu, Wayne Xin Zhao, Ji-Rong Wen
ACL 2023 (Nominated for Best Paper Award)
2022
利用自注意力机制优化费米网络的数值研究
王佳奇，高泽峰*，李永峰，王璐*
天津师范大学学报(自然科学版)
Image Dataset Compression Based on Matrix Product States
Ze-Feng Gao, Peiyu Liu, Wayne Xin Zhao, Zhi-Yuan Xie, Zhong-Yi Lu, Ji-Rong Wen
OpenReview
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models
Ze-Feng Gao*, Peiyu Liu*, Wayne Xin Zhao#, Zhong-Yi Lu, Ji-Rong Wen
COLING2022, Oral Presentation
2021
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators
Peiyu Liu*, Ze-Feng Gao*, Wayne Xin Zhao#, Z.Y. Xie, Zhong-Yi Lu#, Ji-Rong Wen
ACL 2021（Poster)
2020
Compressing LSTM Networks by Matrix Product Operators
Ze-Feng Gao, Xingwei Sun, Lan Gao, Junfeng Li, Zhong-Yi Lu
Arxiv
Compressing deep neural networks by matrix product operators
Ze-Feng Gao, Song Cheng, Rong-Qiang He, Z. Y. Xie, Hui-Hai Zhao, Zhong-Yi Lu, and Tao Xiang
Phys. Rev. Research 2, 023300.
A Model Compression Method With Matrix Product Operators for Speech Enhancement
Xingwei Sun*, Ze-Feng Gao*, Zhong-Yi Lu#, Junfeng Li#, Yonghong Yan
IEEE/ACM Transactions on Audio, Speech, and Language Processing 28, 2837-2847, 2020

Honors and Awards

  • Outstanding graduates, Renmin University of China, 2021
  • National Scholarship for Graduate Student, Ministry of Education of P.R.China, 2020
  • First-class academic scholarship, Renmin University of China, 2020
  • Social Volunteer Service Scholarship, Renmin University of China, 2019
  • First-class academic scholarship, Renmin University of China, 2019
  • First-class academic scholarship, Renmin University of China, 2018
  • First-class academic scholarship, Renmin University of China, 2016
  • Innovation experiment plan for college students, national level, 2013

Contact

Tel：

Email：zfgao@ruc.edu.cn

Website：https://zfgao66.github.io/homepage/

Address：Lide Building 1814