Senior Software Engineer, Model Evaluation

Clera · posted 2 days ago

Open to candidates in United States

$180k–$250k · Full-time · Senior

Sign up and we score this job against your resume. You never pay to apply.

RemoteHunt reads employers' own pages. Free to browse. How we check

What this job asks for

Extracted by RemoteHunt

Must have

  • •3+ years experience, senior/staff capability
  • •Experience designing/writing benchmarks/evaluations
  • •Experience authoring tasks (scope, reference solutions, rubrics)
  • •Hands-on model training/fine-tuning experience
  • •Ability to work with non-ML domain experts

Nice to have

  • •Supply chain, procurement, manufacturing experience
  • •Early-stage startup experience
Read the full posting

About the Role

Join an early-stage AI company building agents for manufacturing and supply chain operations. In this research-focused engineering role, you will work with procurement and manufacturing experts to create benchmarks, train models, and improve agents used in real operational workflows.

What You'll Do

  • Design benchmarks and evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.

  • Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.

  • Train and fine-tune models hands-on, using evaluation results to guide experiments.

  • Identify agent failures, develop improvements, and validate those improvements with measured results.

  • Help establish research and evaluation practices as an early member of the team.

What We're Looking For

  • At least 3 years of experience, with senior- or staff-level capability.

  • Experience designing and writing benchmarks or evaluations.

  • Experience authoring tasks, including defining scope, creating reference solutions or rubrics, and checking task quality.

  • Hands-on experience training and fine-tuning models, beyond using models through APIs.

  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.

  • Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.

Compensation & Benefits

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship policy was not provided.

Location

Fully remote in the United States.

Send this job to a friend:TelegramWhatsApp

More remote Machine Learning Engineer jobs

See all

Get new jobs like this by email

Once a week. Remote machine learning engineer jobs that can hire you in your country.

Hiring in: your countryChange

Weekly, only when there are at least 3 new jobs. No account needed. Unsubscribe in one click. You never pay to apply. Privacy

See how well this job fits your resume

Free, no card.

See my match for each job — free