Software AI Engineer
neurohire.ai
United States; Canada (Remote) · 11d ago
Weekday AI · posted 5 days ago
Open to candidates worldwide
$90–$120 / hr · Full-time · Mid-level
Sign up and we score this job against your resume. You never pay to apply.
RemoteHunt reads employers' own pages. Free to browse. How we check
JAX, XLA, TPU, PyTorch, Pallas, Triton, CUDA, CUTLASS, Kineto, torch.profiler, NVIDIA Nsight, vLLM, SGLang, TensorRT-LLM, JetStream
More remote jobs open to candidates in India, Vietnam, Indonesia, Pakistan, Nigeria, Bangladesh, Malaysia, Philippines, Brazil, Colombia, Kenya, Ghana, Egypt, South Africa, Mexico, Argentina, Turkey, Ukraine, Sri Lanka, Nepal, Italy, Spain, Romania, Serbia, Bulgaria, Greece, United Arab Emirates and Portugal
This role is for one of our clients
Compensation: $90 - $120 per hour
Location: Remote
Job Overview
We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. This role is focused on building, optimizing, debugging, and evaluating the infrastructure that powers large language models and other frontier AI systems.
The ideal candidate will have hands-on experience in ML systems engineering, accelerator performance optimization, distributed workloads, or large-scale model serving. Expertise in areas such as custom accelerator kernels, performance profiling, trace analysis, distributed systems debugging, and high-throughput inference is particularly valuable. Experience with JAX, XLA, and TPU-based infrastructure will be a strong advantage.
In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems.
This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week , with no conflicting professional engagements.
Requirements
Key Responsibilities
Required Qualifications
At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a closely related field.
Practical experience in at least one of the following areas:
Accelerator Kernel Programming: Developing or optimizing custom kernels using Pallas, Triton, CUDA, CUTLASS, or similar technologies.
Performance Profiling: Working with profiling and trace-analysis tools such as JAX/XLA Profiler, Kineto, torch.profiler, or NVIDIA Nsight.
Distributed Workload Debugging: Identifying and resolving performance and execution issues in distributed or accelerator-intensive workloads.
LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching.
Production-level experience with JAX and/or PyTorch.
Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
Demonstrable professional growth and career progression in engineering or infrastructure-focused roles.
Availability to commit at least 40 hours per week on weekdays.
Excellent written communication skills, with the ability to explain complex technical concepts and engineering decisions clearly.
Preferred Qualifications
Engagement Details
neurohire.ai
United States; Canada (Remote) · 11d ago
Blue River Technology
Remote-US · 17d ago
United Kingdom, Remote · 19d ago
Abnormal
Remote - Singapore · 21d ago
Insight Softmax Consulting
Remote · 21d ago
Remote - United States · 28d ago
Once a week. Remote machine learning engineer jobs that can hire you in your country.
Free, no card.
See my match for each job — free