Senior Software Engineer II- AI Platform

Aledade · Remote, United States · posted Oct 20, 2026

Open to candidates in United States

Full-timesenior
Can this job hire you?

We never charge to apply.

What this role actually asks for

Extracted by RemoteHunt

Must have

  • •6+ years experience as an engineer
  • •3+ years experience with SQL
  • •3+ years experience as technical decision-maker
  • •3+ years experience coaching engineers
  • •Experience building production platform infrastructure

Nice to have

  • •Experience with LLM infrastructure
  • •Experience with cloud infrastructure (AWS)
  • •Experience designing observability and operational practices
  • •Experience designing APIs and self-service capabilities
  • •Experience with cost management

Tools and technologies

SQLAWSKubernetesLLMAWS BedrockAzure OpenAIGoogle Vertex AI

The full posting

As a Senior Software Engineer II on Aledade's AI Core Platform team, you will help build and operate the shared infrastructure that enables applications and AI agents across Aledade to securely and reliably access foundation models.

You will work on the platform capabilities behind model access, including model gateways, cloud AI services, provider integrations, routing and fallback, usage controls, observability, reliability, and model governance.

We’re looking for engineers who think beyond implementing individual features and consider the full lifecycle of production platform systems: architecture, scalability, failure modes, security, observability, operational readiness, cost, and developer experience. You will help evolve the platform as AI adoption grows across Aledade, building reusable and self-service capabilities rather than one-off solutions.

You will work closely with engineers, product partners, security, infrastructure teams, and teams building AI applications and agents. Successful engineers in this role are comfortable operating in ambiguous problem spaces, making pragmatic technical decisions, and building secure, maintainable, observable, and resilient systems.

Primary Duties::

  • Develop and implement scalable and performant solutions.

  • Partner, as a peer, with Engineering Managers, Product Managers, and stakeholders throughout Aledade to develop and execute technical roadmaps using Agile processes.

  • Mentor and coach more junior engineers including thorough pull request reviews for other developers and be receptive to critical feedback on your own work.

Minimum Qualifications::

  • BS/BTech (or higher) in Computer Science, Engineering or a related field.

  • 6+ years experience as an engineer building full-stack web applications as part of a cross-functional team.

  • 3+ years of experience working with SQL or other database querying language on large multi-table data sets.

  • 3+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.

  • 3+ years of experience coaching other engineers.

Preferred KSA:: AI Infrastructure & Model Platform:

  • Experience building or operating production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services.
  • Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies.
  • Strong experience with cloud infrastructure, preferably AWS, and technologies such as Kubernetes, containers, and infrastructure as a code
  • Experience designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards and failure handling.
  • Experience designing APIs and self-service platform capabilities used by other engineering teams.
  • Experience with Identity, access control, secrets management, security and governance for shared infrastructure.
  • Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms.
  • Experience operating systems that handle sensitive or regulated data.
  • Ability to evaluate architectural tradeoffs across reliability, performance, security, cost, scalability and developer experience.

Physical Requirements:: Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.

Send this job to a friend:TelegramWhatsApp

Similar remote jobs

Get new jobs like this by email

Once a week. Remote software engineer jobs that can hire you in your country.

Hiring in: your countryChange

Weekly, only when there are at least 3 new jobs. No account needed. Unsubscribe in one click. You never pay to apply. Privacy

Is this one actually worth your time?

RemoteHunt scores every remote job 0–100 against your own resume, so you apply to the handful that fit instead of the hundred that don't. Free plan, no card required.