Senior and/or Principal Software Engineer- LLM Serving Performance

Overview The Microsoft AI Frameworks team develops the software and systems that enable state-of-the-art AI models to run reliably and efficiently at cloud scale. We work across model architectures, frameworks, compilers, runtimes, libraries, and hardware platforms—including NVIDIA and AMD GPUs and Microsoft silicon. We are seeking hands-on Senior and/or Principal Software Engineers to deliver state-of-the-art performance for an LLM serving stack. You will optimize GPU kernels, compilers, runtim