Senior Software Engineer - AI/ML Model Evaluation
The Senior Software Engineer at Confidential Client will develop Reinforcement Learning environments to train and evaluate AI systems on complex coding tasks, focusing on debugging, feature development, refactoring, and performance optimization. This role requires strong software engineering skills across multiple programming languages and emphasizes collaboration within cross-functional and remote teams to deliver scalable, maintainable solutions.
About Careertakes
👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Technology — AI/ML and Software Engineering.
Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.
What You’ll Do
Use your software engineering expertise to design and build reproducible Reinforcement Learning (RL) environments and evaluation pipelines that train and assess AI systems on complex coding tasks. Your work will enable reliable model evaluation, verification, and benchmarking for tasks like debugging, feature development, refactoring, and performance optimization.
- Design, implement, and maintain RL-style environments and harnesses for automated model evaluation.
- Build reproducible testbeds, verification checks, and reference solutions for coding tasks.
- Collaborate with cross-functional engineering and research teams to translate evaluation needs into testable scenarios.
- Debug and diagnose complex software and tooling issues uncovered during evaluation runs.
- Improve tooling to measure performance, correctness, and scalability of candidate solutions.
- Contribute to engineering best practices: code reviews, documentation, and maintainable test artifacts.
Required Qualifications
- Strong proficiency in one or more of: C++, Python, Java, Go, TypeScript, or Rust.
- Deep understanding of algorithms, data structures, and performance tuning.
- Demonstrated experience debugging complex software issues and delivering maintainable solutions.
- Proven track record in feature development and codebase refactoring.
- Experience optimizing software for performance and scalability.
- Excellent written and verbal communication skills and attention to detail.
- Comfortable working in collaborative, cross-functional teams — remote collaboration experience is a plus.
Preferred Qualifications
- Experience with large-scale or distributed codebases.
- Familiarity with AI or machine learning systems (helpful but not required).
- Experience creating reproducible environments and automated verification/benchmarking pipelines.
- Active contributor to code reviews and software development best practices.
Compensation & Location
- Base pay range: $50.00/hr — $100.00/hr (hourly). Actual pay will be based on skills and experience.
- Location: Boardman, OR (United States) — remote-friendly / distributed collaboration expected.
Why Apply via Careertakes
Careertakes acts as a third-party recruiting partner to help you access this opportunity and other matches. We apply third-party recruiting best practices: clear role expectations, concise feedback pathways, and candidate privacy protections. If selected, you will be employed by our client (the Confidential Client).
Legal & Non-Discrimination
Careertakes and our client are committed to lawful, non-discriminatory hiring. We consider applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic. Reasonable accommodations are available upon request for candidates participating in all aspects of the hiring process.
Equal Opportunity & Hiring Transparency
Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.
If you have questions about how your data is used, please contact us directly.
Negotiate a higher salary! Check the salary ranges for this job type in your area.
View My Salary Range