Data Engineer
The Data Engineer at Confidential Client will build and maintain modern data pipelines and warehouses using Azure and Snowflake technologies, integrating AI coding agents into daily workflows. This role involves end-to-end ownership of data ingestion, transformation, governance, and production pipeline reliability in a hybrid work environment, ideal for early-career professionals eager to grow rapidly with AI-driven tools.
About Careertakes
👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, IT.
Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.
Role overview
Join a small, fast-moving data engineering team at a Confidential Client building an AI-native data platform on Azure + Snowflake. This production-facing role ships ingestion and transformation pipelines, applies data governance, and treats AI coding agents (Copilot, Claude Code, etc.) as everyday development partners. Ideal for early-career engineers (0–2+ years) who prioritize learning velocity and practical delivery over years of experience.
What You’ll Do
- Build and maintain ingestion pipelines into Snowflake from Dataverse, SQL Server, APIs, and files using Azure Data Factory.
- Develop transformations in Snowflake following a medallion (bronze → silver → gold) architecture; use Coalesce for orchestrated SQL transformations.
- Write Python for orchestration, automation, connectors, and lightweight services.
- Partner with AI coding agents (GitHub Copilot, Claude Code, Cortex) as part of your day-to-day workflow—direct and validate agent output.
- Apply data governance and lineage standards using Atlan.
- Participate in code reviews, CI/CD via Azure DevOps, and on-call rotations for production pipelines.
- Contribute to runbooks, documentation, and operational playbooks.
Required skills
- Strong Python skills — clean, modular code; familiarity with pandas, requests, basic OOP, virtualenvs.
- Solid SQL fundamentals — joins, window functions, CTEs, and query optimization.
- Hands-on Azure Data Factory experience — pipelines, parameterization, triggers, linked services.
- Practical knowledge of Azure services — Blob/ADLS storage, Key Vault, and DevOps pipelines/repos.
- Snowflake experience — data warehouses, roles, micro-partitions, and transformation workflows.
- Source control proficiency — Git workflows, PRs, and branching.
AI / Agentic skills (conceptual level — required)
- Experience using AI coding agents (Copilot, Cursor, Claude Code) on real tasks.
- Understanding of LLM concepts: prompting, context windows, function calling, and structured outputs.
- Familiarity with RAG patterns (embeddings, retrieval/vector stores, generation).
- Willingness to learn Model Context Protocols (MCP); experience with Atlan MCP or Snowflake MCP is a plus.
Nice to have
- Experience with Coalesce, dbt, or another transformation framework.
- Exposure to Dataverse / Dynamics 365 / Power Platform sources.
- Familiarity with Atlan or other data catalog/governance tools.
- CI/CD experience using Azure DevOps YAML pipelines.
- Experience with vector DBs (Pinecone, Weaviate, pgvector, Snowflake Cortex).
- Personal LLM/agent projects or a public GitHub portfolio.
Mindset we’re hiring for
- Learning mindset — tooling changes fast; you’re energized by that.
- Bias to ship — pragmatic over perfect; iterate quickly.
- AI-leveraged — know when to delegate to agents and when to apply human judgment.
- Ownership — you respond when production pipelines fail, including escalation and remediation.
- Clear written communicator — async-friendly and documents-as-you-go.
Education & experience
- Bachelor’s in CS, Engineering, Math, Stats, or related field — OR equivalent practical experience.
- Bootcamp grads and self-taught engineers with strong portfolios are encouraged to apply.
- Experience: 0–2+ years (entry-level candidates with strong projects welcome).
Logistics & compensation
- Location: Northlake, GA — hybrid.
- Employment type: Full-time.
- Compensation: Base pay depends on skills, experience, and location. (No specific salary range is provided in this posting.) Eligible roles may receive variable pay, bonuses, and benefits including health, retirement, paid time off, and learning & development support.
Confidential Client: hiring & inclusion
Confidential Client is committed to inclusive hiring and equal opportunity employment. The organization follows applicable federal, state, and local laws regarding non-discrimination and reasonable accommodation. Candidates with arrest or conviction records will be considered in jurisdictions with Fair Chance / Ban-the-Box laws where applicable.
Equal Opportunity & Hiring Transparency
Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.
If you have questions about how your data is used, please contact us directly.
Negotiate a higher salary! Check the salary ranges for this job type in your area.
View My Salary Range