careertakescareertakes

Software Engineer, Model Lifecycle and Signals

Confidential Client•Software & Technology
Entry LevelFull-timeOn-SiteN/A
San Francisco, California
6 Days Ago

The Software Engineer on the Model Lifecycle and Signals team at Confidential Client is responsible for bridging frontier AI models with user-facing Cursor products at large scale. This role involves managing model deployment from preview to production, building systems to evaluate and route models effectively, and collaborating across research, inference, product, and data science teams to continuously improve model quality and product impact. The position requires strong software engineering skills, data fluency, and a passion for advancing AI model behavior and evaluation.

Boost your chances. Upload your resume to see your match score.

Unlock Match Rate
Description

About Careertakes

👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Software Development.

Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.


Role overview

Confidential Client is hiring a Software Engineer for the Model Lifecycle and Signals team in San Francisco, CA. You will bridge frontier models to user-facing products: shipping model routing and serving logic, building evaluation and experiment pipelines, surfacing signals that reveal model behavior, and partnering with research, inference, product, and data teams to turn metrics into better models and product experiences. This role focuses on production reliability, measurable quality, and automation at scale.


What You’ll Do

  • Get preview models into production quickly and retire older models without disrupting users.
  • Evaluate preview models and provide actionable feedback to research and model teams.
  • Build and maintain model routing (deciding which model handles each request) to balance quality, latency, and cost at scale.
  • Design and operate signal collection and experimentation platforms that show where each model excels or degrades.
  • Turn ambiguous product quality questions into concrete metrics, pipelines, and decisions.
  • Collaborate closely with data scientists, researchers, inference engineers, and product managers to iterate on model and product behavior.

Minimum qualifications

  • Bachelor's degree in Computer Science, Engineering, Math, or a related scientific discipline; OR 2+ years of professional software engineering experience in lieu of a degree.
  • 2+ years (24 months) of professional experience building production software systems.
  • Strong engineering fundamentals and experience shipping systems people rely on.

Preferred skills & experience

  • Track record of owning projects end-to-end and automating manual processes.
  • Experience building or operating evaluation, measurement, or model-serving systems (AI evals, A/B experimentation, ranking/relevance, routers).
  • Ability to convert qualitative model/product quality signals into metrics, pipelines, and automated decisions.
  • Fluency working with data and collaborating with data scientists and researchers.
  • Curiosity about model and agent behavior and quick iteration with new models and approaches.

Location & worksite requirements

  • This posting is for the San Francisco, CA office. This is an onsite role and candidates must be able to work in person at the San Francisco office. (Local relocation and office-collaboration expectations will be discussed during hiring.)

Compensation & benefits

  • Annual base salary range: $140,000 - $225,000 USD.
  • Final base salary and level will be determined case-by-case and may vary based on job-related knowledge, skills, education, and experience.
  • Total rewards typically include equity, health (medical/vision/dental), 401(k) access, disability and life insurance, and other benefits.

Equal Opportunity & Hiring Transparency

Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.

If you have questions about how your data is used, please contact us directly.

Negotiate a higher salary! Check the salary ranges for this job type in your area.

View My Salary Range