Data Quality Tester

We are looking for a Data Quality Tester to validate data pipelines and ensure data integrity across Azure and Databricks environments.

This role involves developing test strategies, automation scripts, and collaborating with engineering teams to maintain high data quality standards.

Key Responsibilities

• Develop and execute test strategies and automation scripts for data pipelines.
• Validate ETL/ELT pipelines built using Azure Data Factory and Databricks.
• Perform data validation, reconciliation, and comparative analysis between source and target systems.
• Monitor data quality across Delta tables and data warehouses.
• Integrate data testing into CI/CD workflows.
• Document defects and collaborate with engineering teams for resolution.

Required Qualifications

• Strong knowledge of Azure Data Factory and Databricks.
• Proficiency in SQL and scripting languages (Python preferred).
• Experience with data profiling, reconciliation, and schema validation.
• Familiarity with DevOps tools like Azure DevOps or GitHub Actions.
• Understanding of SCD Type 2 and transformation logic.