Samyam Rajbhandari
Samyam Rajbhandari
Microsoft Artificial Intelligence and Research, Ohio State University
Verified email at microsoft.com - Homepage
Title
Cited by
Cited by
Year
Learning intrinsic sparse structures within long short-term memory
W Wen, Y He, S Rajbhandari, M Zhang, W Wang, F Liu, B Hu, Y Chen, ...
arXiv preprint arXiv:1709.05027, 2017
892017
Deepcpu: Serving rnn-based deep learning models 10x faster
M Zhang, S Rajbhandari, W Wang, Y He
2018 {USENIX} Annual Technical Conference ({USENIX}{ATC} 18), 951-965, 2018
442018
A communication-optimal framework for contracting distributed tensors
S Rajbhandari, A Nikam, PW Lai, K Stock, S Krishnamoorthy, ...
SC'14: Proceedings of the International Conference for High Performance …, 2014
262014
Zero: Memory optimization towards training a trillion parameter models
S Rajbhandari, J Rasley, O Ruwase, Y He
arXiv preprint arXiv:1910.02054, 2019
252019
A framework for load balancing of tensor contraction expressions via dynamic task partitioning
PW Lai, K Stock, S Rajbhandari, S Krishnamoorthy, P Sadayappan
Proceedings of the International Conference on High Performance Computing …, 2013
242013
On fusing recursive traversals of Kd trees
S Rajbhandari, J Kim, S Krishnamoorthy, LN Pouchet, F Rastello, ...
Proceedings of the 25th International Conference on Compiler Construction …, 2016
182016
Optimizing CNNs on multicores for scalability, performance and goodput
S Rajbhandari, Y He, O Ruwase, M Carbin, T Chilimbi
ACM SIGARCH Computer Architecture News 45 (1), 267-280, 2017
152017
A domain-specific compiler for a parallel multiresolution adaptive numerical simulation environment
S Rajbhandari, J Kim, S Krishnamoorthy, LN Pouchet, F Rastello, ...
SC'16: Proceedings of the International Conference for High Performance …, 2016
152016
Framework for distributed contractions of tensors with symmetry
S Rajbhandari, A Nikam, PW Lai, K Stock, S Krishnamoorthy, ...
Preprint, Ohio State University, 2013
122013
CAST: Contraction algorithm for symmetric tensors
S Rajbhandari, A Nikam, PW Lai, K Stock, S Krishnamoorthy, ...
2014 43rd International Conference on Parallel Processing, 261-272, 2014
72014
Effective utilization of tensor symmetry in operation optimization of tensor contraction expressions
PW Lai, H Zhang, S Rajbhandari, E Valeev, K Kowalski, P Sadayappan
Procedia Computer Science 9, 412-421, 2012
72012
Neural network training performance optimization framework
TA Chilimbi, O Ruwase, S Rajbhandari, M Carbin, Y He
US Patent App. 14/986,186, 2017
42017
Optimizing the four-index integral transform using data movement lower bounds analysis
S Rajbhandari, F Rastello, K Kowalski, S Krishnamoorthy, P Sadayappan
ACM SIGPLAN Notices 52 (8), 327-340, 2017
32017
DeepSpeed: System Optimizations Enable Training Deep Learning Models with Over 100 Billion Parameters
J Rasley, S Rajbhandari, O Ruwase, Y He
Proceedings of the 26th ACM SIGKDD International Conference on Knowledge …, 2020
12020
Antman: Sparse low-rank compression to accelerate rnn inference
S Rajbhandari, H Shrivastava, Y He
arXiv preprint arXiv:1910.01740, 2019
12019
APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm
H Tang, S Gan, S Rajbhandari, X Lian, C Zhang, J Liu, Y He
arXiv preprint arXiv:2008.11343, 2020
2020
Fast LSTM by dynamic decomposition on cloud and distributed systems
Y You, Y He, S Rajbhandari, W Wang, CJ Hsieh, K Keutzer, J Demmel
Knowledge and Information Systems, 1-29, 2020
2020
Fast LSTM Inference by Dynamic Decomposition on Cloud Systems
Y You, Y He, S Rajbhandari, W Wang, CJ Hsieh, K Keutzer, J Demmel
2019 IEEE International Conference on Data Mining (ICDM), 748-757, 2019
2019
Deep learning model scheduling
M Zhang, S Rajbhandari, W Wang, Y He
US Patent App. 16/018,784, 2019
2019
Locality Optimizations for Regular and Irregular Applications
S Rajbhandari
The Ohio State University, 2016
2016
The system can't perform the operation now. Try again later.
Articles 1–20