Data Analyst - Expert
Raise
- Location: Toronto, ON - Hybrid - (Thursday and 4th Friday of the month - may change due to business requirements)
- Pay Rate: $89.88/hr -$103.89/hr
- Contract Length: 6 Months with possibility for extension
We at Raise are hiring a Data Analyst - Expert for one of our top clients. After establishing themselves as an industry leader, they’re now expanding their team to meet rising demand. We’re hiring right now; if you’re interested, for your chance to join a great place to work
Responsibilities
- Develop and maintain ADF pipelines and Databricks solutions.
- Build Python notebooks using Spark and implement Medallion Architecture.
- Configure Unity Catalog, data governance, security, and permissions.
- Migrate Hive Metastore to Unity Catalog.
- Design and manage Delta Lake tables and schemas.
- Implement CI/CD pipelines using Azure DevOps or GitHub Enterprise.
- Manage Azure resources, Entra ID, SSO, and RBAC.
- Monitor pipelines and optimize performance and costs.
- Troubleshoot technical issues and lead a small team.
Skills
- 7+ Years experience with ADF, Databricks and Azure Functions (C#)
- In depth development experience python/notebook on Databricks/Spark/panda
- Expert working knowledge of Unity Catalog and data governance setup/configuration
- Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
- Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
- Creating delta table schema/tables with proper design/properties & security permissions
- DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
- In depth experience on Azure Entra ID for SSO/RBAC setup
- In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
- Familiar to work in lock down windows environment for highly regulated industry
- Ability to work independently and lead a small team.
- Proven ability to work independently with minimum supervision
- Ability to lead a small team and technical problem-solving sessions
- Excellent Communication skills
- Financial Services Industry experience is an Asset.
Must Have Requirements
- 10+ total experience but for Databricks can be 5-8 years experience.
- ADF orchestrations with Databricks
- Experience with set up and configuration of data governance
- Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
- CI/CD, security
- Monitoring
Nice To Have Skills
- Previous Banking experience or experience in a financial institution.
- Nice to have experience on Delta Live Table.
Reference: WJ-3875_14105522