Ali Hassani
I am a computer science PhD student at Georgia Tech advised by Prof. Humphrey Shi. My primary research area is High Performance AI Architecture, which involves making fast and efficient AI, from neural network architecture down to computer architecture. Since 2022, I've been working on NATTEN, a solution for fast multi-dimensional sparse attention (see my presentation on GPU MODE). In our most recent paper, Generalized Neighborhood Attention, we discuss outstanding challenges in sparse attention infrastructure, and our proposed solutions, which involve both an analytical study, and a fast implementation achieving the maximum speedup theoretically possible. I've been fortunate to have worked at HippoML and NVIDIA (both in production and research teams), through which I've been exposed to some of the most challenging problems in high performance AI.
GitHub / Google Scholar / Twitter / LinkedIn / CV