Advanced Micro Devices company logo
FULL_TIME

Lead HPC & AI Infrastructure Architect

Advanced Micro Devices
San Jose, California, United States 9 days ago
AI overview

Lead HPC & AI Infrastructure Architect at Advanced Micro Devices in San Jose, California, United States focuses on From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation. Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward.



ADVANCE YOUR CAREER. ADVANCE THE WORLD. 

At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. 

Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.




THE ROLE

We are seeking a Lead HPC & AI Infrastructure Architect to own the architecture and technical direction of large-scale CPU and GPU platforms across on-premises infrastructure, public cloud, and specialized GPU cloud providers. You will translate scientific computing, engineering, and AI requirements into secure, reliable, and cost-effective platforms for tightly coupled HPC workloads, distributed model training, and inference services.

This hands-on leadership role spans design, workload validation, deployment, and lifecycle management. You will guide infrastructure engineering and SRE teams and partner with researchers, AI engineers, cloud providers, and hardware vendors to deliver production-ready platforms.

THE PERSON

You combine deep systems expertise with practical architectural judgment. You take ownership of complex technical problems, validate decisions with measurable results, and communicate tradeoffs clearly. You collaborate across engineering, operations, security, and research teams; mentor engineers; and balance performance, reliability, security, delivery timelines, and cost. You can independently guide initiatives from requirements through production acceptance.

KEY RESPONSIBILITIES

  • Own the HPC and AI infrastructure roadmap, reference architectures, and standards for CPU/GPU clusters. Define workload placement across bare metal, virtual machines, Slurm, and Kubernetes.
  • Lead designs covering CPU/NUMA and GPU topology, accelerator interconnects, networking, storage, and identity. Establish validated hardware, firmware, driver, and runtime baselines.
  • Architect RDMA-capable fabrics and storage tiers. Validate collective communication, parallel I/O, dataset delivery, and checkpoint performance at target scale.
  • Design resource sharing through Slurm accounting, fair-share, quotas, QoS, preemption, and tenant isolation. Enable reproducible environments, self-service onboarding, and inference capacity planning.
  • Standardize provisioning, configuration, and fleet upgrades through infrastructure as code, automation, and CI/CD; manage images, containers, and configuration drift.
  • Define production acceptance criteria, service-level objectives, and fleet observability. Partner with SRE on fault isolation, job recovery, checkpoint/restart, incident analysis, and capacity planning.
  • Benchmark HPC and distributed AI workloads; improve scaling efficiency, throughput, inference latency, GPU utilization, and cost efficiency through bottleneck analysis.
  • Embed federated identity, least-privilege access, tenant and network isolation, secrets management, controlled container privileges, audit logging, and vulnerability management.
  • Lead architecture reviews, proofs of concept, provider evaluations, and technical escalations. Document tradeoffs, mentor engineers, and align delivery with stakeholders and infrastructure partners.
 

PREFERRED EXPERIENCE

  • Typically 10+ years in infrastructure, cloud engineering, or distributed systems, including 5+ years designing and delivering production HPC or GPU platforms; equivalent demonstrated experience is welcome.
  • Ownership of large-scale cluster deployments involving hundreds of nodes or comparable complexity, with measurable improvements in workload performance, reliability, or cost.
  • Deep expertise in a major cloud platform such as Azure, OCI, or AWS, with experience integrating cloud and on-premises systems. Familiarity with specialized GPU providers such as Crusoe or TensorWave.
  • Strong Linux troubleshooting skills across CPU/NUMA topology, PCIe, GPU connectivity, drivers, virtualization, containers, and distributed runtime environments.
  • Hands-on Slurm scheduling and resource governance, plus Kubernetes experience. Understanding of MPI, distributed training, collective communication, and AI inference infrastructure.
  • AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting.
  • HPC networking and storage, including RDMA, RoCE or InfiniBand, topology and oversubscription tradeoffs, parallel I/O, data placement, checkpointing, and enterprise connectivity.
  • Parallel and shared storage technologies such as Lustre, IBM Storage Scale, BeeGFS, NFS, or VAST, and object storage; network, storage, and collective benchmarks for cluster acceptance.
  • Terraform or equivalent infrastructure as code, Ansible or comparable configuration management, Python or Bash, and Git-based CI/CD. Familiarity with Azure CycleCloud or AWS ParallelCluster.
  • Observability and SRE practices using tools such as Prometheus and Grafana, including secure access, resource controls, fault recovery, and production readiness.
  • Experience establishing observability and SRE practices using tools such as Prometheus and Grafana, and designing security boundaries and resource controls for shared infrastructure.

  • Ability to lead cross-functional technical work independently, communicate architecture tradeoffs clearly, and guide projects from requirements through production acceptance.

  • Coordination with hardware and data center teams on rack power, liquid cooling, facility capacity, and other constraints affecting GPU platform design.

Preferred qualifications

  • Hands-on experience with AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting.
  • Experience with Azure, OCI, Crusoe, or TensorWave GPU environments, and cluster provisioning frameworks such as Azure CycleCloud or AWS ParallelCluster.
  • Experience with Lustre, IBM Storage Scale, BeeGFS, or VAST, plus network, storage, and collective communication benchmarks used for cluster acceptance.
  • Experience with LLM serving platforms such as vLLM or SGLang, model parallelism, inference capacity planning, and usage accounting or cost allocation.
  • Understanding of rack power, liquid cooling, and facility capacity constraints, with experience coordinating platform requirements with hardware and data center teams.

ACADEMIC CREDENTIALS

Bachelor's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience.

This role is not eligible for visa sponsorship.

#LI-RD1




Benefits offered are described:  AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.  AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

ContractFULL_TIME
Posted9 days ago
AI Research Scientist — Agentic AI and Foundation Models
Advanced Micro Devices · Santa Clara, California, United States
Serdes Silicon Design and Micro-Architecture Engineer
Advanced Micro Devices · San Jose, California, United States
Finance Manager- Internal Controls and Compliance
Advanced Micro Devices · Austin, Texas, United States
CPU Core RTL Design Engineer
Advanced Micro Devices · Austin, Texas, United States
ML Compiler Engineer
Advanced Micro Devices · San Jose, California, United States
Generative AI Engineer - Graphics
Advanced Micro Devices · Austin, Texas, United States
CPU Cache Architect
Advanced Micro Devices · Fort Collins, Colorado, United States
CPU Cache Architect
Advanced Micro Devices · Fort Collins, Colorado, United States
PLL Design/ Integration Sr Staff Engineer
Advanced Micro Devices · San Jose, California, United States
AI Solution Architect
Advanced Micro Devices · San Jose, California, United States
Campaign Creative Lead, Consumer
Advanced Micro Devices · Austin, Texas, United States
Lead AI/ML - NPU Validation Engineer
Advanced Micro Devices · Hyderabad, Telangana, India
Senior Analog layout Engineer
Advanced Micro Devices · Hyderabad, Telangana, India
Leadership Role - Formal Verification
Advanced Micro Devices · Bangalore, Karnataka, India
AI framework Eng.
Advanced Micro Devices · Shanghai, Shanghai, China
RTL Design Engineer
Advanced Micro Devices · MARKHAM, Ontario, Canada
ASIC Design Engineer, PCIe IP Enablement
Advanced Micro Devices · MARKHAM, Ontario, Canada
System/Test Validation Engineer
Advanced Micro Devices · Hsinchu, Taiwan
Sys/Test Validation Engineer
Advanced Micro Devices · Hsinchu, Taiwan
Facilities Manager
Advanced Micro Devices · Singapore, Singapore

Frequently asked questions