IT & Software

Databricks Architect – Informatica, Spark & PySpark

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!

Brampton · Peel Region · Canada

Job Description:

Databricks Architect (with Informatica)-Databricks, Informatica PowerCenter and/or IICS/IDMC, Spark, PySpark, SQL, Delta Lake, Unity Catalog.

Brampton, ON - Hybrid (4 Days WFO)

Role Descriptions:

Design and implement scalable data platforms using Databricks Lakehouse| Delta Lake| Spark| and PySpark.Architect batch and real-time data pipelines on Azure/AWS/GCP.Lead ETL modernization and migration from Informatica PowerCenter/IICS/IDMC to Databricks.Define data governance| security| performance optimization| and best practices.Collaborate with business and technical teams to deliver enterprise data solutions.

Essential Skills:

  • Required Skills:-Strong expertise in Databricks| Spark| PySpark| SQL| Delta Lake| Unity Catalog.
  • Hands-on experience with Informatica PowerCenter and/or IICS/IDMC.
  • Experience in data warehousing| data modeling| and cloud platforms (Azure preferred).
  • Knowledge of CI/CD| Git| and Agile methodologies.
  • Preferred Skills:-Databricks and Cloud certifications.
  • Experience with Snowflake| Azure Synapse| Kafka| or Data Governance tools.

#J-18808-Ljbffr

Reference: WJ-3875_12060107

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.