Senior Databricks Data Platform Engineer

Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.

As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL, Delta Lake, and cloud platforms to modernize data environments. Own delivery from discovery through production while mentoring engineers and shaping technical direction.

Key Responsibilities:

• Architect enterprise-scale platforms through production deployment
• Define roadmaps aligned with client business goals
• Develop Databricks pipelines and Spark applications
• Lead architecture reviews and mentor Data Engineers
• Implement governance, monitoring, and security practices

Requirements:

• Eight-plus years designing enterprise data platforms
• Five-plus years using Databricks and Apache Spark
• Strong Python, SQL, Delta Lake, and Lakehouse expertise
• Cloud experience with AWS, Azure, or Google Cloud Platform
• Enterprise leadership and stakeholder management experience

Bring Databricks, Spark, Python, and technical leadership to enterprise data modernization at ShyftLabs in Toronto.