Software Engineer, AI
The Software Engineer, AI at Confidential Client is responsible for designing and deploying advanced AI systems that automate complex audit and accounting workflows using LLM-powered agents and retrieval technologies. This role involves close collaboration with cross-functional teams to build reliable, scalable, and secure AI solutions that enhance product quality and customer trust in a fast-paced, on-site startup environment.
About Careertakes
👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Software Development.
Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.
What You'll Do
Confidential Client is hiring experienced engineers to design, build, and operate production AI systems that automate audit and accounting workflows. You will own features end-to-end — from model and agent design to monitoring, evaluation, and customer-facing reliability.
- Build and improve LLM‑powered workflows and agentic systems for audit and accounting use cases
- Design and ship production retrieval, document‑intelligence, and reasoning systems
- Create evaluations, monitoring, guardrails, and human‑in‑the‑loop review systems to improve AI quality
- Partner with domain experts and Audit Engineers to translate real customer workflows into reliable software
- Improve prompt engineering, tool integration, orchestration, and evaluation pipelines
- Optimize accuracy, reliability, latency, and cost for production AI workflows
- Collaborate with platform and SRE engineers on observability and incident response for AI failures
- Debug failure modes in live customer workflows and iterate on fixes that increase adoption
- Help define technical standards and best practices for safe, dependable AI systems
Who You Are
You build reliable systems, understand probabilistic model behavior, and ship with product judgment. You’re comfortable owning complex production features and working closely with domain experts.
- 2–5 years of professional software engineering experience
- Proven experience building and operating production software systems (backend or full‑stack)
- Hands‑on experience with LLMs, agents, retrieval systems, or other modern AI model integrations
- Experience designing evaluations and improving model/system performance using production data
- Comfortable designing systems that handle uncertainty, failure modes, and partial correctness
- Strong product judgment; able to identify the simplest solution that delivers customer value
- Excellent communication, high ownership, and strong technical judgment
- Willing and excited to work in person with a fast‑moving, talent‑dense team
Nice to Have / Bonus Experience
- Production LLM application development
- Experience with agent frameworks, evals, retrieval pipelines, or tool‑calling architectures
- Background in fintech, compliance, accounting, audit, legaltech, or other trust‑sensitive software
- Experience with document‑heavy workflows and document intelligence systems
- Prior experience at early‑stage startups or high‑pace product teams
The Environment
- On-site in New York, NY — 5 days/week (no remote or hybrid)
- Startup hours and pace — this is not a strict 9‑to‑5 role
- Flat structure and high ownership — team members ship and own outcomes
Benefits
- Unlimited PTO
- Wellhub Platinum membership
- Comprehensive health, dental, and vision coverage
- Free company dinner every day
Equal Opportunity & Hiring Transparency
Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.
If you have questions about how your data is used, please contact us directly.
Negotiate a higher salary! Check the salary ranges for this job type in your area.
View My Salary Range