Nvidia
Senior Software Engineer
Overview
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and scale workloads across multi-GPU, multi-node, and multi-cloud environments.
About Nvidia
NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Our mission is to advance AI research and development to create groundbreaking technologies that enable anyone to harness the power of AI and benefit from its potential.
Requirements & Eligibility
- Bachelor’s degree in Computer Science, Computer Engineering or Software Engineering with 7+ years of experience; alternatively, Master’s degree with 5+ years of experience; or PhD degree with thesis and top-tier publications in ML Systems, GPU archit
- Strong programming skills in Python and C/C++
- Solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, distributed systems, deep learning theories
- Knowledgeable and passionate about performance engineering in ML frameworks and inference engines
- Familiarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL
- Experience with containers and orchestration such as Docker, Kubernetes, and Slurm
Key Responsibilities
- Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features; profile and optimize the inference framework
- Develop, optimize, and benchmark GPU kernels using techniques such as fusion, autotuning, and memory/layout optimization
- Define and build inference benchmarking methodologies and tools; contribute both new benchmark and NVIDIA’s submissions to the MLPerf Inference benchmarking suite
- Architect the scheduling and orchestration of containerized large-scale inference deployments on GPU clusters across clouds
- Conduct and publish original research that pushes the pareto frontier for the field of ML Systems
Disclaimer: Trace Hiring is an independent job board. We are not directly affiliated with Nvidia. Please verify all details on the official company application portal.