Software Engineer, Ingestion Platform
The Software Engineer on Confidential Client's Data Movement team is responsible for developing and maintaining scalable, fault-tolerant data infrastructure to support machine learning and analytics workflows from hundreds of millions of users. This role involves owning the Data Movement Platform, enhancing technologies like Spark, Flink, and Airflow, and building automated, self-service solutions to improve data processing efficiency and reliability across the company. The position supports critical business functions by enabling efficient batch and streaming data processing in a collaborative, remote-friendly environment.
About Careertakes
👉 Important disclosure: Careertakes is a third-party recruiting platform supporting this hiring process. If selected, you will be employed directly by our client, Social Networking Platforms.
Applicants for this role may also receive access to additional matched opportunities through the Careertakes platform.
What You’ll Do
This role is on a Data Movement / Data Platform team responsible for moving, orchestrating, and making data easy to consume for analytics and ML workflows. You will design, build, and operate scalable, fault-tolerant systems that process high-volume event and batch data.
- Refine and maintain data infrastructure that supports ML and analytics workflows at scale (batch + streaming).
- Own components of the Data Movement Platform used to enable Spark, Flink, and Airflow-based processing.
- Design and implement new infrastructure and automation that reduces toil and provides a declarative, self-service experience for data users.
- Build, test, and deploy services with strong observability, monitoring, and alerting; share on-call responsibilities with the team.
- Contribute to platform efficiency, latency, and reliability improvements and collaborate with partner teams to enable production workloads.
Who You Are / Qualifications
We’re looking for someone who can deliver production-quality software and platform features quickly, safely, and at scale.
- 2+ years of software engineering experience delivering production services.
- Proficient with object-oriented or systems programming (Python, Scala, Go, or Java).
- Experience building or operating large-scale distributed systems and data platforms.
- Familiarity with Spark, Flink, Airflow, Kubernetes, and CI/CD best practices.
- Comfortable working with cloud services and modern infrastructure patterns.
- Strong communicator, collaborative, and able to participate effectively in cross-team projects and on-call rotations.
Preferred (nice-to-have):
- Prior experience contributing to data-platform tooling or self-serve data platforms.
- Background with streaming and batch processing at high throughput.
This role is remote-friendly (telecommute/TELECOMMUTE) and will be based in San Francisco, CA per the authoritative job location.
Benefits & Perks
- Comprehensive healthcare and income-replacement programs
- 401(k) plan with employer match
- Global benefits that support workspace, professional development, and caregiving
- Family planning and gender-affirming care support
- Mental health and coaching resources
- Flexible vacation and paid volunteer time off
- Generous paid parental leave
- Equity in the form of restricted stock units may be offered depending on role
Compensation
To comply with applicable pay-transparency requirements, the base salary range for this U.S.-based role is:
- $164,200 — $229,900 USD (base salary)
Final offers consider experience, skills, and other factors. The position may also be eligible for equity (RSUs) and other incentive programs.
Location & Work Arrangement
- Authoritative location: San Francisco, CA, USA.
- Remote-friendly / Telecommute options available; candidate must be eligible to work in the United States.
Equal Opportunity & Hiring Transparency
Careertakes and our client are Equal Opportunity Employers committed to building a diverse and inclusive workforce. We prohibit discrimination or harassment of any kind. To support a fair and efficient hiring process, AI tools may be used to assist with application review or resume screening. These tools do not replace human decision-making. Final hiring decisions are made by people.
If you have questions about how your data is used, please contact us directly.
Negotiate a higher salary! Check the salary ranges for this job type in your area.
View My Salary Range