Senior System Software Engineer – Dynamo

Job Description

Join NVIDIA as a Senior System Software Engineer to drive innovation in AI model serving. You'll develop open-source software for GPU-accelerated inference, focusing on disaggregated serving for Dynamo-supported engines like vLLM, SGLang, and TRT-LLM. This role involves optimizing large KV cache management across heterogeneous memory and storage, building new features for the Dynamo Rust Runtime Core Library, and designing scalable, high-performance distributed inference components in Rust and Python.

Qualifications

1. Master's or PhD in Computer Science, Computer Engineering, or related field. 2. 3+ years of experience in Computer Science, Computer Engineering, or related field. 3. Excellent Rust, Python, and C++ programming and software design skills, including debugging, performance analysis, and test design. 4. Experience with high-scale distributed systems and ML systems.

Benefits

- Equity - Benefits