Senior Forward Deployed Engineer (FDE) for AI and GenAI Inference Optimization

About AMD and the Role

AMD is seeking a Senior Forward Deployed Engineer (FDE) for AI and GenAI Inference Optimization to join its team in Riyadh, Riyadh, Saudi Arabia. This is a full-time, customer-facing position within the Forward Deployed Engineering (FDE) team. The role involves working directly with strategic partners and customers to enable, optimize, and deploy state-of-the-art GenAI inference workloads on AMD data center CPUs and GPUs, specifically the Instinct™ family. The successful candidate will bridge the gap between advanced AI models and AMD hardware to achieve competitive performance across the full inference stack.

Key Responsibilities

• Partner with customers to enable and optimize large language models (LLMs) and multimodal models on AMD Instinct GPUs, ensuring committed performance and accuracy targets are met.
• Optimize GenAI inference pipelines on vLLM and SGLang, incorporating techniques such as PD disaggregation, expert parallelism (EP/wide-EP), tensor/data parallelism, speculative decoding, and KV cache management.
• Develop and tune low-level GPU kernels using Triton, HIP, or composable kernels for operations including attention, MoE, GEMM, quantization, and normalization.
• Profile end-to-end workloads, identify bottlenecks across GPU/CPU boundaries, and deliver measurable throughput and latency improvements against competitive targets.
• Enable advanced data types and techniques, such as FP8, MXFP4, and sparse attention, with a focus on both performance and numerical accuracy.
• Debug complex runtime, stability, and accuracy issues in production environments, collaborating with core engineering teams to identify root causes and contribute fixes.
• Contribute optimizations to open-source frameworks (vLLM, SGLang, ATOM, AITER) and internal libraries, documenting best practices and delivering production-ready artifacts to customers.
• Leverage AI-assisted coding tools and agentic workflows to accelerate development, debugging, optimization, and code review across the inference stack.

Qualifications and Experience

• A Bachelor's, Master's, or PhD in Computer Science, Electrical Engineering, or a related field, combined with 8+ years of relevant experience.
• Deep expertise in GPU architecture and performance optimization, including hands-on experience with AMD ROCm (or CUDA) and GPU kernel development.
• Strong proficiency in Python and C++, with experience developing and optimizing kernels using Triton, HIP, or CUDA.
• Experience with AI-assisted coding and agentic development tools (*, GitHub Copilot, Claude, Cursor, or equivalent) to enhance productivity in kernel development, large-scale codebase navigation, debugging, and framework integration.
• Experience working with LLM inference frameworks (vLLM, SGLang, or equivalent) and serving optimization techniques.
• Solid understanding of transformer and MoE architectures, quantization, and distributed inference strategies (TP, DP, EP, and related parallelism techniques).
• Proficiency with profiling and debugging tools (*, rocProfiler, ROCdebug-agent).

Preferred Qualifications

• Experience optimizing frontier models (DeepSeek, Qwen, Kimi, MiniMax, GLM, etc.) in production environments.
• A track record of contributing to open-source AI inference frameworks.
• Experience integrating AI-driven automation into engineering workflows and developer tooling.
• Strong customer-facing communication skills and the ability to manage technical deliverables against committed timelines.

Work Environment

This role is based in Riyadh, Riyadh, Saudi Arabia, and is a full-time position. The successful candidate will work within a dynamic team focused on advancing technology that moves the world forward, contributing to innovations in healthcare, scientific discovery, and AI.

About AMD

At AMD, technology is leveraged to address important global challenges, from advancing healthcare and scientific discovery to powering AI and everyday technologies. Innovation at AMD is focused on shaping the future, with every role contributing to developing next-generation processors, enabling AI breakthroughs, and bringing leading-edge products to market.