About Careertakes

👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Technology, Information and Internet.

Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.

---

What You’ll Do

Confidential Client is hiring an entry-level Software Engineer to help design, build, and operate platforms and services for machine learning, generative AI, and agentic experiences. You will work on infrastructure that accelerates model development, deployment, and observability while focusing on performance, cost efficiency, and responsible data use.

• Build and maintain scalable platforms and services that power ML, generative AI, and agentic product experiences
• Prototype and evaluate emerging ML technologies, including ML frameworks, LLMs, and agentic systems
• Design and improve GPU-backed infrastructure and model-serving pipelines
• Improve developer productivity by enhancing reliability, monitoring, and cost-efficiency of AI development workflows
• Collaborate across engineering, research, and product teams to deploy systems that balance latency, throughput, and data governance

---

Core Responsibilities

• Implement production services that support model training, inference, and orchestration at scale
• Work with distributed systems patterns to ensure reliability and availability
• Add observability (metrics, logs, tracing) and automated alerting to critical AI infrastructure
• Help optimize compute usage and drive cost-effective GPU utilization
• Participate in design reviews, postmortems, and continuous improvement practices

---

Minimum Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience
• Strong software engineering fundamentals: data structures, algorithms, and systems design
• Proficiency in one or more languages used for backend and ML infra (Python, Go, Java, or similar)
• Familiarity with ML frameworks (e.g., TensorFlow, PyTorch) and basic ML concepts
• Understanding of distributed systems and experience with cloud infrastructure (compute, networking, storage)
• Good debugging skills and experience with observability tools (metrics, logging, tracing)
• Strong collaboration and communication skills; ability to work on cross-functional teams

---

Preferred Qualifications

• Experience or coursework with large language models (LLMs), agentic systems, or model serving
• Practical exposure to GPU infrastructure, performance optimization, or CUDA-aware tooling
• Familiarity with container orchestration (Kubernetes), CI/CD, and infra-as-code practices
• Experience operating production services with attention to latency, throughput, and cost trade-offs

---

Why Join

• Work on cutting-edge generative AI and ML platform problems at scale
• Cross-functional environment with engineers, researchers, and product leaders
• Opportunity to grow in ML infrastructure, LLMs, and large-scale distributed systems

---

Equal Opportunity & Hiring Transparency

Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.

If you have questions about how your data is used, please contact us directly.