2025

SelectFormer: Private and Practical Data Selection for Transformers
SelectFormer: Private and Practical Data Selection for Transformers

Xu Ouyang, Felix Xiaozhu Lin, Yangfeng Ji

The Thirteenth International Conference on Learning Representations (ICLR) 2025

SelectFormer: Private and Practical Data Selection for Transformers

Xu Ouyang, Felix Xiaozhu Lin, Yangfeng Ji

The Thirteenth International Conference on Learning Representations (ICLR) 2025

2024

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens
Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

Xu Ouyang, Tao Ge, Thomas Hartvigsen, Zhisong Zhang, Haitao Mi, Dong Yu

Arxiv 2024

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

Xu Ouyang, Tao Ge, Thomas Hartvigsen, Zhisong Zhang, Haitao Mi, Dong Yu

Arxiv 2024

2023

Efficient NLP Model Finetuning via Multistage Data Filtering
Efficient NLP Model Finetuning via Multistage Data Filtering

Xu Ouyang, Shahina Mohd Azam Ansari, Felix Xiaozhu Lin, Yangfeng Ji

International Joint Conference On Artificial Intelligence (IJCAI) 2023

Efficient NLP Model Finetuning via Multistage Data Filtering

Xu Ouyang, Shahina Mohd Azam Ansari, Felix Xiaozhu Lin, Yangfeng Ji

International Joint Conference On Artificial Intelligence (IJCAI) 2023

2022

Supertickets: Drawing Task-agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
Supertickets: Drawing Task-agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning

Haoran You, Baopu Li, Zhanyi Sun, Xu Ouyang, Yingyan Lin

The European Conference on Computer Vision (ECCV) 2022

Supertickets: Drawing Task-agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning

Haoran You, Baopu Li, Zhanyi Sun, Xu Ouyang, Yingyan Lin

The European Conference on Computer Vision (ECCV) 2022

Contrastive Quant: Quantization Makes Stronger Contrastive Learning
Contrastive Quant: Quantization Makes Stronger Contrastive Learning

Yonggan Fu, Qixuan Yu, Meng Li, Xu Ouyang, Vikas Chandra, Yingyan Lin

ACM/IEEE Design Automation Conference (DAC) 2022

Contrastive Quant: Quantization Makes Stronger Contrastive Learning

Yonggan Fu, Qixuan Yu, Meng Li, Xu Ouyang, Vikas Chandra, Yingyan Lin

ACM/IEEE Design Automation Conference (DAC) 2022

I-FlatCam: A 253 FPS, 91.49 µJ/frame Ultra-compact Intelligent Lensless Camera for Real-time and Efficient Eye Tracking in VR/AR
I-FlatCam: A 253 FPS, 91.49 µJ/frame Ultra-compact Intelligent Lensless Camera for Real-time and Efficient Eye Tracking in VR/AR

Yang Zhao, Ziyun Li, Yonggan Fu, Yongan Zhang, Chaojian Li, Cheng Wan, Haoran You, Shang Wu, Xu Ouyang, Vivek Boominathan, Ashok Veeraraghavan, Yingyan Lin

IEEE Symposium on VLSI Technology and Circuits (VLSI) 2022

I-FlatCam: A 253 FPS, 91.49 µJ/frame Ultra-compact Intelligent Lensless Camera for Real-time and Efficient Eye Tracking in VR/AR

Yang Zhao, Ziyun Li, Yonggan Fu, Yongan Zhang, Chaojian Li, Cheng Wan, Haoran You, Shang Wu, Xu Ouyang, Vivek Boominathan, Ashok Veeraraghavan, Yingyan Lin

IEEE Symposium on VLSI Technology and Circuits (VLSI) 2022

e-G2C: A 0.14-to-8.31 µJ/Inference NN-based Processor with Continuous On-chip Adaptation for Anomaly Detection and ECG Conversion from EGM
e-G2C: A 0.14-to-8.31 µJ/Inference NN-based Processor with Continuous On-chip Adaptation for Anomaly Detection and ECG Conversion from EGM

Yang Zhao, Yongan Zhang, Yonggan Fu, Xu Ouyang, Cheng Wan, Shang Wu, Anton Banta, Mathews M John, Allison Post, Mehdi Razavi, Joseph Cavallaro, Behnaam Aazhang, Yingyan Lin

IEEE Symposium on VLSI Technology and Circuits (VLSI) 2022

e-G2C: A 0.14-to-8.31 µJ/Inference NN-based Processor with Continuous On-chip Adaptation for Anomaly Detection and ECG Conversion from EGM

Yang Zhao, Yongan Zhang, Yonggan Fu, Xu Ouyang, Cheng Wan, Shang Wu, Anton Banta, Mathews M John, Allison Post, Mehdi Razavi, Joseph Cavallaro, Behnaam Aazhang, Yingyan Lin

IEEE Symposium on VLSI Technology and Circuits (VLSI) 2022

2021

Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness are Found within Randomly Initialized Networks
Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness are Found within Randomly Initialized Networks

Yonggan Fu, Qixuan Yu, Yang Zhang, Shang Wu, Xu Ouyang, David Cox, Yingyan Lin

The Conference on Neural Information Processing Systems (NeurIPS) 2021

Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness are Found within Randomly Initialized Networks

Yonggan Fu, Qixuan Yu, Yang Zhang, Shang Wu, Xu Ouyang, David Cox, Yingyan Lin

The Conference on Neural Information Processing Systems (NeurIPS) 2021

'BNN-BN=?': Training Binary Neural Networks Without Batch Normalization
'BNN-BN=?': Training Binary Neural Networks Without Batch Normalization

Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

'BNN-BN=?': Training Binary Neural Networks Without Batch Normalization

Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021