Cloud Data Engineer
Symbiotic Group
Job Description
Location: Toronto, ON
Job ID#: RQ11486
Duration: 6 Months
Role Overview
We are seeking an experienced Cloud Data Engineer to design,build, optimize, and support enterprise-scale cloud data solutions. Thesuccessful candidate will play a key role in developing end-to-end datapipelines, implementing modern DataOps practices, and enabling scalable cloud-baseddata platforms that support business and operational objectives.
This position requires expertise in cloud data engineering,data migration, ETL/ELT development, automation, data warehousing, andlarge-scale data transformation initiatives.
Key Responsibilities
- Designand develop data pipelines from source systems through to end-userconsumption.
- Optimizeand maintain high-performance data pipelines.
- Developand manage cloud-based data platforms, data storage, and data exchangesolutions.
- Build,orchestrate, deploy, and automate data workflows and pipelines.
- Developintegrations across multiple platforms using various programming languagesand scripting techniques.
- ApplyDataOps principles, best practices, and Agile delivery methodologies.
- ImplementContinuous Integration and Continuous Deployment (CI/CD) processes andautomation.
- Supportdata provisioning, data exchange, and data security initiatives.
- Designand implement large-scale data migration and transformation solutionsacross cloud environments.
- Developfact/dimension models, enterprise data warehouses, data lakes, and datalakehouse architectures.
- Managecloud data services including storage repositories, data lakes,lakehouses, key vaults, virtual machines, and related infrastructure.
- Supportstructured, semi-structured, and unstructured data ingestion,provisioning, and data exchange processes.
- Monitor,troubleshoot, tune, and optimize DataOps solutions.
- Collaboratewith technical and business stakeholders to deliver scalable datasolutions.
Mandatory Skills & Experience (8+ Years)
- Design,build, automate, and optimize complex ETL/ELT processes using Databricks,Delta Live Tables (DLT), or equivalent technologies.
- Developmentof unified data platforms using Databricks and Unity Catalog orequivalent.
- Strongexperience with relational databases including Oracle, MySQL, and SQLServer.
- Expertisein relational and dimensional data modeling.
- AdvancedSQL development and query optimization.
- Experiencewith data replication and database administration.
- AdvancedSQL skills including PL/SQL and T-SQL.
- Experienceworking with Big Data processing frameworks such as PySpark.
- Experiencebuilding custom Databricks pipelines integrated with CI/CD processes andAzure DevOps Git Integration.
- Experiencewith data migration and integration across platforms including:
- Oracleto Databricks
- Oracleto Microsoft Fabric
Desired Skills & Experience
- Datalake and lakehouse architecture design utilizing Medallion Architecture.
- Advancedexperience with Oracle databases, Azure SQL Server, and Azure DataFactory.
- Experiencewith cloud platforms including Azure, AWS, and Google Cloud Platform(GCP).
- Experiencetroubleshooting, performance tuning, failover, recovery, and productionsupport.
- Experiencewith Python, Unix Shell Scripting, and Scala.
Additional Information
- Hybridwork arrangement.
- Candidatesshould be available during standard business hours.
- Stronganalytical, problem-solving, communication, and stakeholder managementskills are required.
- Provenability to work independently as well as within collaborative projectteams.
- Experiencedelivering enterprise data warehouse, data lake, and cloud modernizationinitiatives is highly desirable.
About Symbiotic Digital.
Symbiotic Digital provides the IT Experts you need thatsolve problems and get things done. See what the top 2% in their field can dofor you. (Symbiotic Digital is a division of Symbiotic Group Inc.)
We serve customers in two ways, we provide:
- DigitalExperts: IT Consulting expertise. Bright Minds That Produce Proven Results
- Recruitment:Find The Right People You Need
Serving IT & Business leaders, Symbiotic Digitalprovides a business system that enable us to provide the Expert Technical staffneeded to solve challenging business and IT problems. IT leaders in the mostreputable organizations in Canada have relied on Symbiotic Digital to help themstaff difficult assignments with proven Experts uniquely evaluated by ourproven QMS- Quality Management System Staff Development Model. We are a 100%Indigenous owned company.
Reference: WJ-4483_1386209