AI Software Engineer - Operations
The AI Software Engineer at Confidential Client is responsible for designing and developing AI-driven applications that integrate large language models into user-facing products, focusing on backend orchestration, prompt engineering, and intuitive user interfaces. This role involves building scalable, production-ready AI solutions leveraging LLM APIs and frameworks, collaborating with cross-functional teams to advance manufacturing and operational business priorities while ensuring responsible AI practices.
About Careertakes
👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Semiconductor Manufacturing.
Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.
What You’ll Do
You will design and build production-ready AI applications that embed large language model (LLM) capabilities into user-facing products for manufacturing operations. This role focuses on application development, orchestration, and user experience rather than model training. You’ll build scalable backend services, prototype intuitive UIs, integrate LLM APIs, and operationalize retrieval-augmented generation (RAG) solutions to improve decision-making across operations.
Responsibilities
- Build and maintain scalable backend services to orchestrate LLM interactions, prompts, and multi-step workflows
- Prototype and develop intuitive web-based UIs (chat/assistant interfaces) to enable efficient human–AI interaction
- Integrate LLM APIs and vendor platforms (e.g., OpenAI, Azure OpenAI, Anthropic) into production applications
- Develop and manage prompt engineering strategies and prompt lifecycle for reliability and performance
- Implement retrieval-augmented generation (RAG) using internal and external data sources and vector search
- Design ETL/data pipelines and connectors to enterprise systems (databases, APIs, knowledge bases, Snowflake, SAP)
- Deploy and operate microservices-based architectures with monitoring for latency, cost, and response quality
- Collaborate with product managers, data scientists, and business stakeholders to translate requirements into AI-enabled solutions
- Ensure responsible AI practices: privacy, security, logging, and bias mitigation
- Rapidly prototype, test with users, and iterate based on feedback
Minimum Qualifications
- Bachelor’s degree in Computer Science, Software Engineering, or a related field
- Minimum 3 years of professional software development experience
- Strong programming skills in Python, JavaScript, or similar languages
- Experience building AI products that use LLM frameworks (e.g., LangChain, Semantic Kernel, LlamaIndex)
- Practical knowledge of RAG patterns and vector databases (examples: Pinecone, FAISS, Azure Cognitive Search)
- Experience with vector DBs such as Milvus and knowledge graphs (e.g., Neo4j)
- Experience orchestrating multi-step AI workflows or agent-based systems
- Familiarity integrating with enterprise platforms (Snowflake, SAP, REST APIs)
- Experience designing conversational/chat interfaces or assistant UIs
- Experience deploying scalable microservices architectures
- Strong UI/UX sensibility for AI-driven applications and experience with modern frontend frameworks (React, Angular, etc.)
- Experience working in cross-functional teams delivering production-grade AI solutions
Preferred Qualifications
- Prior experience in manufacturing or semiconductor operations environments
- Hands-on experience with specific vector DB tooling in production (Milvus, Pinecone, FAISS)
- Familiarity with evaluation techniques for LLM outputs and hallucination mitigation strategies
- Exposure to prompt optimization and fine-tuning concepts (even if not responsible for model training)
- Experience with agent orchestration frameworks or multi-step pipeline automation
- Experience with monitoring/cost-control strategies for LLM usage
About the Confidential Client
Confidential Client is a global leader in Semiconductor Manufacturing focused on inspection tools, metrology systems, process solutions, and computational analytics. The organization solves complex challenges at scale and applies machine learning and advanced analytics to improve manufacturing throughput, quality, and cost-efficiency.
Total Rewards
- Base pay range (Ann Arbor, MI): $90,400 - $153,700 per year
- Competitive benefits may include medical, dental, vision, life insurance, 401(k) with company match, employee stock purchase plans, tuition reimbursement, career development programs, paid time off and holidays, family leave, and wellness resources.
- Actual pay depends on role level, location, skills, and experience. Recruiter can provide more details during the hiring process.
Recruiter Notes (Careertakes)
- This listing is posted by Careertakes as a recruiting partner. We screen and match candidates for Confidential Client using proven third-party recruiting best practices.
- Applicants may be considered for other matched roles on the Careertakes platform.
- Reasonable accommodations are available for applicants with disabilities during the application and interview process — request details through the recruiter contact provided after you apply.
Equal Opportunity & Hiring Transparency
Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.
If you have questions about how your data is used, please contact us directly.
Negotiate a higher salary! Check the salary ranges for this job type in your area.
View My Salary Range