Senior Technology Architect_ Databricks

As a Senior Databricks Architect, you will design and operate scalable data pipelines and products to support a modern data mesh. You will help integrate legacy systems with cloud-native platforms, enabling analytics and self-serve insights across domains. You’ll work on batch and streaming data assets, using Databricks and a medallion data architecture to deliver reusable data products. This role focuses on data quality, governance, and cross-functional collaboration to drive data-driven outcomes. You will join a global, innovation-driven organization delivering cloud-enabled analytics at scale.

• Competitive compensation including bonus

• Build and maintain batch and streaming data pipelines from legacy DB2 and on-prem SQL Server to an AWS-based data lake
• Implement real-time ingestion using Confluent Kafka and land data in Amazon S3
• Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold)
• Design and deliver high-quality, reusable data products aligned to data mesh principles
• Ensure data quality, reliability, security, and governance across pipelines
• Collaborate with domain teams, platform teams, and stakeholders to enable self-serve analytics and consumption

• Databricks (Spark, PySpark/SQL) expert
• Streaming technologies, especially Kafka/Confluent Kafka
• Experience integrating legacy data sources such as DB2 and SQL Server
• Working knowledge of AWS data services, especially S3
• Understanding of data product thinking, data mesh concepts, and modern data engineering best practices

• High analytical skills
• Initiative and flexibility
• High customer orientation
• Databricks (Spark, PySpark/SQL)
• Confluent Kafka
• DB2 (mainframe)