Efficient machine learning, distributed optimization, and transformers
Rui Liu
Efficient machine learning, distributed optimization, and transformers
Selected publications
Communication-efficient Distributed Learning for Large Batch Optimization
ICML 2022 · International Conference on Machine Learning
Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers
CoRR 2022 · Computing Research Repository
Project ↗
Cite
@article{827b5848-9769-4515-859a-00684c66001b,
title = {Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers},
author = {Rui Liu and Young Jin Kim and Alexandre Muzio and Barzan Mozafari and Hany Hassan Awadalla},
journal = {Computing Research Repository},
year = {2022},
doi = {10.48550/arXiv.2205.14336}
}Transformer with Memory Replay
AAAI 2022 · AAAI Conference on Artificial Intelligence
Adam with Bandit Sampling for Deep Learning
NeurIPS 2020 · Conference on Neural Information Processing Systems
A Bandit Approach to Maximum Inner Product Search
AAAI 2019 · AAAI Conference on Artificial Intelligence
Paper ↗Technical Report ↗Project ↗
Cite
@inproceedings{9c840b8a-a86d-4d1a-b574-e66882839453,
title = {A Bandit Approach to Maximum Inner Product Search},
author = {Rui Liu and Tianyi Wu and Barzan Mozafari},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2019},
doi = {10.1609/aaai.v33i01.33014376}
}