IT & Software

Microsoft Fabric & Airflow Resource

TechDoQuest

Brampton · Peel Region · Canada

This job posting is for an existing, active vacancy and we are looking to hire Microsoft Fabric & Airflow Resource at Brampton, ON .

Responsibilities:

  • Lead the offshore engineering pod, providing mentorship and guidance to team members.
  • Design, build, and optimize data pipelines in Fabric Data Factory.
  • Orchestrate workloads using Fabric Airflow to ensure efficient data processing.
  • Manage Lakehouse and Warehouse items in OneLake, including configuration of shortcuts to various cloud storage solutions.
  • Implement and maintain Direct Lake semantic model configurations and Oracle mirroring setups.
  • Utilize Spark, PySpark, SQL, T SQL, and Delta Lake for data processing and transformation.
  • Conduct interoperability testing with Databricks and Snowflake to ensure seamless integration.
  • Utilize Azure DevOps and Git for version control and CI/CD of Fabric artifacts.
  • Monitor consumption using the Fabric Capacity Metrics app and perform disciplined benchmarking.
  • Document technical processes and maintain clean technical documentation.
  • Coordinate across time zones with an onsite architect to ensure project alignment.

Mandatory Skills:

  • Strong experience with Data Fabric technologies.
  • Proficient in building and tuning pipelines in Fabric Data Factory.
  • Hands on experience with Fabric Airflow for workload orchestration.
  • Expertise in managing Lakehouse and Warehouse items in OneLake.
  • Solid understanding of cloud storage solutions: ADLS Gen2, AWS S3, and GCP Cloud Storage.
  • Proficient in Spark, PySpark, SQL, T SQL, and Delta Lake.
  • Experience with Direct Lake semantic model configuration and Oracle mirroring setup.
  • Familiarity with Databricks and Snowflake for interoperability testing.
  • Fluency in Azure DevOps and Git for version control and CI/CD.
  • Experience using the Fabric Capacity Metrics app for monitoring.

Preferred Skills:

  • Experience in mentoring and leading engineering teams.
  • Strong analytical and problem-solving skills.
  • Excellent communication skills, both verbal and written.
#J-18808-Ljbffr

Reference: WJ-3875_13860646

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.