[Remote] Director, AI Infrastructure

Note: The job is a remote job and is open to candidates in USA. Vultr is a leading cloud infrastructure company on a mission to provide high-performance cloud solutions. They are seeking a Director of AI Infrastructure to lead engineering teams in building and operating AI clusters, ensuring reliability and performance while collaborating with cross-functional teams.

Responsibilities

• Lead engineering team responsible for implementation, scaling, and operation of AI compute clusters.
• Partner with senior leadership to shape infrastructure roadmaps and translate high-level strategy into actionable engineering plans.
• Drive execution of cluster deployments, hardware bring-up, node-level configuration, integration and validation with orchestration systems.
• Oversee engineering efforts related to GPU fleet growth, networking design integration, and storage systems that support ML and high-performance workloads.
• Ensure reliability, performance, and availability of the infrastructure through monitoring, automation, and well-defined operational processes.
• Work with AI/ML teams, SRE, networking, and hardware engineering to align cluster capabilities with training and inference requirements.
• Improve provisioning, configuration management, and lifecycle operations for large bare metal and GPU fleets.
• Contribute to the design of multi-tenant scheduling, workload management, and resource orchestration, in partnership with the cluster architect.
• Manage technical incident response and proactively identify areas for performance improvement or architectural refinement.
• Mentor and grow engineering talent, fostering a high-performance, detail-oriented culture.
• Collaborate closely with Product to clarify requirements, delivery timelines, and customer-facing capabilities. Skills
• Extensive experience (typically 8–12 years) in infrastructure engineering, HPC, large-scale systems, or similar domains.
• Strong understanding of AI compute infrastructure, including GPU/CPU clusters, distributed training workflows, and high-performance networking (InfiniBand/RDMA).
• Experience running production bare metal platforms or hardware fleets at meaningful scale.
• Technical depth in Linux systems, Kubernetes or Slurm, provisioning tools (Terraform, Ansible), observability stacks, and networking fundamentals.
• Hands-on experience with cluster operations, hardware bring-up, distributed systems, or ML workload scaling.
• Demonstrated ability to lead and develop engineering teams while staying close to the technical details.
• Excellent cross-functional communication and ability to partner with architecture, AI/ML, SRE, Networking, and Infrastructure Operations teams.
• Strong execution mindset with the ability to translate strategic goals into measurable engineering deliverables.

Benefits

• 100% company-paid insurance premiums for employee medical, dental and vision plans.
• 401(k) plan that matches 100% up to 4%, with immediate vesting
• Professional Development Reimbursement of $2,500 each year
• 11 Holidays + Paid Time Off Accrual + Rollover Plan
• Increased PTO at 3 year and 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year
• $500 stipend for remote office setup in first year + $400 each following year
• Internet reimbursement up to $75 per month
• Gym membership reimbursement up to $50 per month
• Company paid Wellable subscription Company Overview
• Vultr is an AI cloud infrastructure platform offering latest generation NVIDIA GPUs and AMD CPUs and GPUs across 32 worldwide regions It was founded in 2014, and is headquartered in West Palm Beach, Florida, USA, with a workforce of 201-500 employees. Its website is Company H1B Sponsorship
• Vultr has a track record of offering H1B sponsorships, with 1 in 2024. Please note that this does not guarantee sponsorship for this specific role.

Apply To this Job