About Careertakes

👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Technology, Information and Media.

Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.

---

About the Role

Confidential Client is hiring a Software Engineer to design and build production-grade systems that analyze, visualize, and monitor large-scale AI agent data. You’ll work on tools that enable developer experimentation (A/B testing), exploratory conversational data analysis (an Explorer product), and proactive monitoring to surface defects or emergent behaviors. This is an opportunity to ship full-stack systems that directly improve agent performance and the developer experience.

---

What You’ll Do

• Design and implement systems to analyze and visualize millions of agent-performance data points to produce actionable insights.
• Build and extend A/B testing frameworks that let agent developers run experiments and measure outcomes.
• Develop Explorer — an AI-powered conversational data clustering and analysis tool for exploring datasets and surfacing patterns.
• Implement monitoring and alerting systems that proactively detect defects, anomalies, or new patterns in agent behavior.
• Collaborate with data scientists, product managers, designers, and engineering peers to define requirements and deliver high-quality solutions.
• Ensure systems are scalable, maintainable, and follow engineering best practices through code reviews, documentation, and testing.
• Share knowledge, mentor teammates, and contribute to a culture of craftsmanship and continuous improvement.

---

Qualifications

• 4+ years building production-grade, full-stack software systems or equivalent professional experience.
• Strong computer science fundamentals (data structures, algorithms, systems design) — degree or equivalent professional experience.
• Proven experience designing scalable backend systems and developer tooling.
• Familiarity with programming languages and stacks mentioned in the role (Go, TypeScript) or similar modern backend/frontend stacks.
• Experience with large-scale data processing, visualization, or analytics platforms.
• Experience building experiment/A-B testing frameworks, monitoring systems, or anomaly detection pipelines is highly desirable.
• Ability to work independently, take technical ownership, and communicate effectively across cross-functional teams.
• Leadership experience on technical projects or teams is a plus.

---

Benefits

Confidential Client offers a comprehensive benefits package (may vary by location). Typical benefits include:

• Flexible/unlimited paid time off and paid parental leave
• Medical, dental, and vision coverage options
• Life and disability insurance
• Retirement plan options (location dependent)
• Parental, fertility, and family-building benefits
• Discretionary stipend for professional or personal use
• On-site/perks such as food/snacks (region dependent)
• A collaborative environment focused on craftsmanship and impact

---

Role Details

• Seniority level: Associate
• Employment type: Full-time
• Job function: Information Technology
• Industries: Technology, Information and Media

---

Equal Opportunity & Hiring Transparency

Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.

If you have questions about how your data is used, please contact us directly.