Post a job

Infrastructure Operations Engineer (GPU Computing) - Enterprise AI

Aethir logo

Location
United States
Aethir

Job Description

Aethir is a pioneering technology company at the forefront of GPU-based compute infrastructure, specializing in cutting-edge solutions for diverse industries ranging from AI and machine learning to high-performance computing (HPC). We're dedicated to pushing the boundaries of what's possible, leveraging the latest advancements in hardware and software to empower our clients with unparalleled computational capabilities.

About the Role:

We are seeking a highly skilled and motivated Infrastructure Operations Engineer to join our dynamic team. As an integral member of the InfraOps team, you will play a key role in managing and optimizing our GPU-based compute infrastructure (across multiple locations and partners), ensuring maximum performance, scalability, and reliability.

Responsibilities:

  • Infrastructure Management: Deploy, configure, and maintain GPU-based compute infrastructure, including servers, storage, networking, and associated software stack. Aethir facilitates compute from dozens of providers around the world, from 4090s to H200s.
  • Monitoring and Optimization: Implement robust monitoring and alerting systems to proactively identify performance bottlenecks, resource constraints, and potential failures. Continuously optimize infrastructure to improve performance, efficiency, and cost-effectiveness.
  • Automation and Orchestration: Develop automation scripts and tools to streamline deployment, configuration, and management of infrastructure components. Implement infrastructure as code (IaC) principles to enable rapid provisioning and scaling.
  • Security and Compliance: Implement and enforce security best practices to safeguard sensitive data and ensure compliance with relevant regulations and industry standards. Conduct regular security audits and vulnerability assessments.
  • Incident Response and Troubleshooting: Provide tier-3 support for infrastructure-related issues, investigating root causes and implementing timely resolutions. Participate in on-call rotation to respond to critical incidents outside of regular business hours.
  • Capacity Planning and Scaling: Collaborate with cross-functional teams to forecast resource requirements, plan capacity upgrades, and scale infrastructure to accommodate growing workloads and user demands.
  • Documentation and Knowledge Sharing: Maintain comprehensive documentation of infrastructure configurations, procedures, and troubleshooting guidelines. Share knowledge and best practices with team members to foster continuous learning and skill development.

Requirements

  • Experience in infrastructure operations, preferably in a DevOps or SRE role or Sales Engineering or Solution Architect role - focused on GPU compute.
  • Proficiency in managing GPU-based compute infrastructure, including NVIDIA GPUs and CUDA programming.
  • Strong expertise in Linux system administration and shell scripting (e.g., Bash, Python).
  • Experience with configuration management tools (e.g., Ansible, Chef, Puppet) and version control systems (e.g., Git).
  • Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
  • Solid understanding of networking concepts, protocols, and troubleshooting techniques.
  • Excellent analytical and problem-solving skills, with a proactive and results-oriented mindset.
  • Effective communication skills and the ability to collaborate effectively with cross-functional teams. We operate in English, but speaking Mandarin as well is a big bonus as we have engineering teams in China and Southeast Asia.
  • Experience with cloud computing platforms (e.g., AWS, Azure, GCP) and hybrid cloud architectures.
  • Knowledge of HPC frameworks and job scheduling systems (e.g., Slurm, PBS Pro).
  • Familiarity with GPU-accelerated libraries and frameworks (e.g., TensorFlow, PyTorch, CUDA Toolkit).
  • Understanding of cybersecurity principles and practices, including encryption, access controls, and threat detection/prevention.
  • Bonus if you know Web3 (cryptocurrency, tokenization of RWAs, mining/staking, etc.).

Benefits

  • Competitive compensation structure (and flexible on fiat/token mix).
  • Can be flexible on benefits, depending on location and setup.
  • Salary is also flexible depending on location and setup.
  • Flexible work hours and remote work options.

Advice from our career coach

In my experience, the role of Infrastructure Operations Engineer at Aethir is a high-impact position requiring a combination of technical expertise and practical experience in managing GPU-based compute infrastructure. To stand out as an applicant, consider the following tips:

  • Highlight your experience in infrastructure operations, ideally in a DevOps or SRE role, with a focus on GPU compute.
  • Showcase your proficiency in managing GPU-based compute infrastructure, including NVIDIA GPUs and CUDA programming.
  • Demonstrate strong expertise in Linux system administration and shell scripting, such as Bash and Python.
  • Emphasize your experience with configuration management tools like Ansible, Chef, or Puppet, as well as version control systems like Git.
  • Highlight your familiarity with containerization and orchestration technologies, such as Docker and Kubernetes.
  • Illustrate your understanding of networking concepts, protocols, and troubleshooting techniques.
  • Highlight your effective communication skills and ability to collaborate with cross-functional teams, especially if you speak Mandarin due to engineering teams in China and Southeast Asia.
  • Showcase your experience with cloud computing platforms and hybrid cloud architectures, along with knowledge of HPC frameworks and job scheduling systems.
  • Demonstrate familiarity with GPU-accelerated libraries and frameworks, such as TensorFlow, PyTorch, and CUDA Toolkit.
  • Show understanding of cybersecurity principles and practices, including encryption, access controls, and threat detection/prevention.
  • If you have knowledge of Web3 (cryptocurrency, tokenization of RWAs, mining/staking, etc.), be sure to highlight it as a bonus skill.

Apply for this job

Expired?

Please let Aethir know you found this job with RemoteJobs.org. This helps us grow!

RemoteJobs.org mascot