QA Automation Engineer – Data Migration & Databricks Validation
Are you ready to lead data quality assurance for large-scale pipelines and Python-based processes? Apply Now!
Working with one of our top financial clients, this role calls for a QA Automation Engineer – Data Migration & Databricks Validation who can validate complex data transformations, ensure reliable ETL outcomes, and strengthen automated testing practices in a Databricks environment.
Pay rate range (CAD): $50.00/hr – $55.00/hr
Responsibilities
- Design, build, and maintain automated data validation scripts for ETL and data pipelines
- Validate large-scale data volumes across transformations and pipeline outputs
- Perform SQL-based testing and verification using SSMS and database queries
- Test and assess Python-based processes to confirm data correctness and reliability
- Verify data quality for ingested files, structured outputs, and downstream datasets
- Ensure testing coverage for backend/data workflows in environments with no UI testing
- Support quality practices within Databricks-based development workflows
Desired Skill-Set
- Strong QA automation experience in data-centric environments
- Experience validating large volumes of data and ETL pipelines
- Advanced SQL skills with hands-on SSMS experience
- Ability to write and maintain automated data validation scripts
- Experience testing Python scripts
- Experience validating data files, transformations, and data quality
- Exposure to Databricks and Unity Catalog
- Ability to work effectively in back-end/data testing only (no UI testing)
Nice to Have
- Basic understanding of Mutual Funds and GICs
- Experience working on data migration or cloud modernization projects
BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.