Software R&D Engineer - GPU Kernel Development

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you'll discover the real differentiator is our culture. We push the limits of innovation to solve the world's most important challenges-striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

Key Responsibilities

• Develop GPU Kernels: Create andoptimizeGPU kernels to maximize performance for specificML/AI/HPC workloadson pre-silicon architectures.

• Develop & Optimize Models: Design andoptimize low-level GPU kernels to accelerate inference and training of large machine learning models. Maximize computational efficiency and reduce execution time while ensuring model accuracy.

• Multi-GPU and Multi-Node Optimization: Design and implement strategies for distributed model training and inference across multiple GPUs and nodes. Address data parallelism and model parallelism challenges to fullyutilizeavailable resources.

• Performance Profiling: Profile and analyze system and application performance toidentifybottlenecks and areas for improvement. Use profiling tools to understand andoptimizehardware resourceutilization.

• Parallel Computing:Leverageparallel computing techniques to improve the scalability and performance of machine learning workloads. Implement multi-threading and GPU synchronization techniques.

• Benchmarking and Testing: Develop benchmarks and testing procedures to assess the performance and stability of optimized models and frameworks. Ensure that the solutions meet or exceed the defined performance criteria.

• ML Frameworks: Use, enhance andoptimizeframeworks likePyTorch,vLLM,SGLangfor AMD GPUs in open-source repositories.

• Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improveworkloadsperformance on AMD GPUsand pre-silicon architectures.

• Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions.

• Documentation: Create detailed documentation of optimizations, best practices, and implementation guidelines tofacilitateknowledge sharing and maintainable code.

Required Experience

• Proficient in C++ programming,C++17 and/or C++20.

• Experienced in designing andoptimizingGPU kernels on AMD/Nvidia GPUs using HIP, CUDA, and/or assembly (ASM).

• Experienced in low-level programming to maximize performance for AI operations,leveragingtools like Compute Kernel (CK) and/or CUTLASS for multi-GPU and multi-platform performance.

• Experience using profiling and benchmark tooling for large models.

• Excellent problem-solving skills and attention to detail.

• Strong communicationand teamwork skills.

PreferredExperience

• Experience inC++23/26.

• Experience with model optimization, such as low-precision quantization (MXFP4, FP8, INT4).

• Experience with AI software frameworks, such asPyTorch,vLLM,SGLang, etc.

• Knowledgeofmodelarchitectures, LLMs,MoE, and diffusion.

• Knowledge of AMD architectures (GCN, RDNA, CDNA)

• Experience in running large-scaleHPCworkloads on heterogeneouscomputeclusters,optimizing forefficiency and scalability.

• Knowledge of compiler theory and tools like LLVM andROCmfor kernel and system performance optimization.

Academic Credentials

• PhD in Computer Science, ComputationalScience,Computer Engineering, Electrical Engineering, ora related field.

#LI-RL1

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here.

This posting is for an existing vacancy.