Senior Data Engineer
kargo
You join Kargo to advance scalable data infrastructure and privacy-conscious targeting at a global scale. In this role you will implement and optimize data pipelines, collaborate with tech leads, and drive robust data processes that power high-impact targeting systems. You’ll help shape data architecture, improve reliability, and explore new approaches to onboarding and analytics. This is an opportunity to work across a modern stack in a collaborative, growth-focused environment with a strong emphasis on privacy and performance.
Responsibilities- Design, implement, and optimize ETL/ELT pipelines using Python, Airflow, Spark, Iceberg, Snowflake, Aerospike, Docker, Kubernetes (EKS), AWS, and real-time streaming (Kafka, Flink).
- Contribute to collaborative design sessions and propose technical solutions for complex data engineering challenges.
- Define and implement testing strategies and promote CI/CD practices with ArgoCD for reliable deployments.
- Monitor, tune, and optimize data systems for reliability, performance, and cost-efficiency.
- Onboard new datasets and enhance targeting capabilities while exploring privacy-compliant methodologies.
- Document technical implementations, procedures, and best practices to support knowledge sharing.
- Extensive experience building and maintaining large-scale data systems with minimal supervision.
- Strong skills in Python, Spark, and Iceberg; ability to optimize data structures for performance.
- Preference for experience with Airflow for data workflows.
- DevOps proficiency in AWS (including EKS), Docker, Kubernetes, and CI/CD automation with ArgoCD; monitoring with Prometheus.
- Experience with analytical warehousing (Snowflake or Clickhouse) and SQL performance/cost awareness.
- Agile experience with Jira and Confluence for task management and documentation.
- Proven ability to drive implementation independently and turn ambiguity into executable actions.
- Excellent communication with technical teams and stakeholders; familiarity with identity, privacy, and targeting methodologies in AdTech.
- strong communication
- collaboration
- problem-solving
- Python
- Spark
- Iceberg
Reference: WJ-747_30173031