Data Analyst - Expert
Raise
We at Raise are hiring a
Data Analyst - Expert
for one of our top clients. After establishing themselves as an industry leader, they're now expanding their team to meet rising demand.
Location: Toronto, ON - (Hybrid 1- Thursday and 4th Friday of the month - may change due to business requirements)
Pay Rate: $89.88/hr -$103.89/hr
Contract Length: 6 Months with possibility for extension
Responsibilities
Develop and maintain data solutions using ADF, Databricks, Azure Functions, Python, and Spark.
Build ADF-to-Databricks data pipelines using Medallion Architecture and Delta Lake.
Design and manage Unity Catalog, data governance, security, and permissions.
Migrate Databricks environments from Hive Metastore to Unity Catalog.
Create and manage Delta tables, schemas, and data security configurations.
Implement CI/CD and deployment pipelines using Azure DevOps/GitHub Enterprise.
Work with Azure services including ADLS, Azure SQL, Synapse, ADF/SHIR, and Databricks.
Perform performance tuning, cost optimization, monitoring, and troubleshooting.
Lead a small team, conduct technical problem-solving sessions, and work independently.
Collaborate effectively with stakeholders using strong communication skills.
Must Have Requirements
7+ Years experience with ADF, Databricks and Azure Functions (C#)
In depth development experience python/notebook on Databricks/Spark/panda
Expert working knowledge of Unity Catalog and data governance setup/configuration
Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
Creating delta table schema/tables with proper design/properties & security permissions
DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
In depth experience on Azure Entra ID for SSO/RBAC setup
In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
Familiar to work in lock down windows environment for highly regulated industry
Ability to work independently and lead a small team.
Proven ability to work independently with minimum supervision
Ability to lead a small team and technical problem-solving sessions
Excellent Communication skills
ADF orchestrations with Databricks.
Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
CI/CD, security
Monitoring
Nice To Have Skills
Previous Banking experience or experience in a financial institution.
Nice to have experience on Delta Live Table.
Financial Services Industry experience is an Asset.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer and request accommodation:
Data Analyst - Expert
for one of our top clients. After establishing themselves as an industry leader, they're now expanding their team to meet rising demand.
Location: Toronto, ON - (Hybrid 1- Thursday and 4th Friday of the month - may change due to business requirements)
Pay Rate: $89.88/hr -$103.89/hr
Contract Length: 6 Months with possibility for extension
Responsibilities
Develop and maintain data solutions using ADF, Databricks, Azure Functions, Python, and Spark.
Build ADF-to-Databricks data pipelines using Medallion Architecture and Delta Lake.
Design and manage Unity Catalog, data governance, security, and permissions.
Migrate Databricks environments from Hive Metastore to Unity Catalog.
Create and manage Delta tables, schemas, and data security configurations.
Implement CI/CD and deployment pipelines using Azure DevOps/GitHub Enterprise.
Work with Azure services including ADLS, Azure SQL, Synapse, ADF/SHIR, and Databricks.
Perform performance tuning, cost optimization, monitoring, and troubleshooting.
Lead a small team, conduct technical problem-solving sessions, and work independently.
Collaborate effectively with stakeholders using strong communication skills.
Must Have Requirements
7+ Years experience with ADF, Databricks and Azure Functions (C#)
In depth development experience python/notebook on Databricks/Spark/panda
Expert working knowledge of Unity Catalog and data governance setup/configuration
Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
Creating delta table schema/tables with proper design/properties & security permissions
DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
In depth experience on Azure Entra ID for SSO/RBAC setup
In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
Familiar to work in lock down windows environment for highly regulated industry
Ability to work independently and lead a small team.
Proven ability to work independently with minimum supervision
Ability to lead a small team and technical problem-solving sessions
Excellent Communication skills
ADF orchestrations with Databricks.
Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
CI/CD, security
Monitoring
Nice To Have Skills
Previous Banking experience or experience in a financial institution.
Nice to have experience on Delta Live Table.
Financial Services Industry experience is an Asset.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer and request accommodation:
Reference: WJ-3875_12939897