About

I am a final-year PhD student in the Computer Science and Engineering (CSE) Division at the University of Michigan advised by Michał Dereziński. Prior to joining CSE, I completed a Master’s degree in Mathematics at the Indian Institute of Technology (IIT) Bombay, and worked in the banking industry for three years. I develop scalable machine learning algorithms for distributed and memory-constrained settings, with the goal of preserving statistical accuracy while reducing communication, computation, and memory costs. A central theme of my work is identifying model compression opportunities and designing distributed optimization methods that efficiently harness the compute capabilities of modern hardware accelerators. The theoretical foundations of my work lie in randomized numerical linear algebra, random matrix theory, and high-dimensional statistics.

I am on the academic job market and currently looking for postdoctoral opportunities.

Publications

Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration ↗
S. Garg, M. Dereziński. To appear in NeurIPS, 2026.
Debiasing Random Oblique Projections for Subsampled OLS and Fast CUR in High Dimensions ↗
C. Niu, S. Garg, M. Dereziński, Z. Liao. To appear in NeurIPS, 2026.
Second-order information promotes mini-batch robustness in variance-reduced gradients ↗
S. Garg, A. Berahas, M. Dereziński. Journal of Machine Learning Research, 2026.
Faster Low-Rank Approximation and Kernel Ridge Regression via the Block-Nyström Method ↗
S. Garg, M. Dereziński. Conference on Learning Theory, 2025.
Turbocharging Gaussian Process Inference with Approximate Sketch-and-Project ↗
P. Rathore, Z. Frangella, S. Garg, S. Fazliani, M. Dereziński, M. Udell. NeurIPS, 2025.
Distributed Least Squares in Small Space via Sketching and Bias Reduction ↗
S. Garg, K. Tan, M. Dereziński. NeurIPS, 2024.

Teaching

Algorithms for Data Science
Graduate Student Instructor — Winter 2023, Winter 2024, Fall 2024
Foundations of Computer Science
Graduate Student Instructor — Winter 2026
sachg@umich.edu
Email