Sr. Machine Learning Engineer

Das ist der Job

You’ll own benchmark development and model failure analysis for the CUA training pipeline.

Darum lohnt es sich

Responsibilities Land new benchmarks and eval suites for the CUA models Run model evaluations against checkpoints and analyze results Perform model failure analysis — dig into where the model breaks down and why Write Python and SQL to process, transform, and analyze large-scale data Support automation of eval workflows over time Collaborate with research scientists, engineers, and TPMs on the team Document methodology and results Communicate findings clearly to stakeholders Top Skills python, SQL, Data Analysis, Machine Learning, Model Evaluation, Benchmarking, Failure Analysis, Eval Automation, RL/RLHF Exposure, LLM Evaluation Experience, Log Analysis Additional Skills & Qualifications Bachelor's degree in Computer Science, Statistics, ML, or related field 5+ years of experience in data analysis / ML engineering Strong proficiency in Python Proficient in SQL Hands‑on experience with model evaluation and benchmarking Ability to perform rigorous model failure analysis Comfortable working with Linux systems Strong communication and collaboration skills Ability to work independently and in a fast-moving team environment Job Type & Location This is a Contract position based out of Menlo Park, CA.

Pay and Benefits The pay range for this position is $70.00 - $85.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms.

If eligible, the benefits available for this temporary role may include the following: Medical, dental & vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan – Pre‑tax and Roth post‑tax contributions available Life Insurance (Voluntary Life & AD&D for the employee and dependents) Short and long‑term disability Health Spending Account (HSA) Transportation benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a hybrid position in Menlo Park, CA.

AI helps assess applications and qualifications, but final decisions are made by our hiring team. Description As a ML Engineer, you’ll be joining this client as the begin building the next generation of Computer Use Agents (CUA).

You’ll be running evaluations against model checkpoints, analyzing where and why the model fails, and feeding those insights back into the training loop. Application Deadline This position is anticipated to close on Jul 10, 2026.

Equal Opportunity Employer The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Legal Statements San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.

Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. By applying, you acknowledge and agree that your application may be reviewed using AI tools. #J-18808-Ljbffr