Paid, remote AI evaluation work for data scientists and ML engineers (part-time, contract)
This part-time, contract role involves remote AI evaluation work where data scientists and machine learning engineers are paid to write challenging problems, review AI-generated code and analyses, and grade model answers. The position supports AI developers by ensuring quality training data and model assessments, offering flexible remote work opportunities for qualified professionals.
About Careertakes
👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Non-profit Organization Management.
Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.
What You’ll Do
This is a paid, part-time, contract role reviewing and grading model outputs and training data for AI systems. Tasks include:
- Review AI-written answers, code sketches, and analyses and score them against provided rubrics
- Write and/or refine challenging evaluation prompts and test cases for models
- Provide clear, constructive feedback and edge-case notes for annotators and model engineers
- Follow detailed instructions and maintain consistent, reproducible scoring
- Log time and complete tasks on schedule; communicate issues or ambiguous examples promptly
Who We’re Looking For
We’re seeking U.S.-based data scientists or machine learning engineers (including entry-level candidates) who want flexible, paid, remote work. Ideal candidates have:
- Familiarity with machine learning concepts and model evaluation
- Experience reading and assessing code, analyses, or technical writeups (comfort with Python/pseudocode is a plus)
- Strong attention to detail and ability to apply rubric-based scoring consistently
- Good written communication for concise feedback
- Reliable internet access and the ability to work remotely on a contract basis
Role Details
- Employment type: Part-time, contract
- Schedule: Flexible hours (task-based); volume may vary week-to-week
- Location: Remote — United States (contractors must be authorized to work/accept payments in the U.S.)
- Seniority: Entry level — open to early-career data scientists and ML engineers
Compensation & Tools
- This is paid, hourly work (rate communicated by the client during selection). No salary is listed in the source posting.
- You will use provided guidelines, scoring rubrics, and an online platform to submit evaluations.
Legal & Access Notes
- Candidates should confirm their employer’s outside-work policies before applying.
- This role is open to U.S. residents only; contractors must be able to receive payments in the United States.
Why This Opportunity
- Work remotely on flexible, paid tasks that leverage ML/data-science expertise
- Gain experience contributing to AI training and evaluation workflows
- Part-time contract structure — add this work to an existing schedule
Equal Opportunity & Hiring Transparency
Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.
If you have questions about how your data is used, please contact us directly.
Negotiate a higher salary! Check the salary ranges for this job type in your area.
View My Salary Range