Sr Databricks Engineer (Banking)
Looking for a skilled Databricks Engineer to support a major data modernization project? Apply Now!
Working with one of our top financial clients, this role calls for a Sr Databricks Engineer (Banking). The successful candidate will play a key role in transforming legacy platforms into modern, scalable data solutions on Azure Databricks, supporting enterprise-scale data workflows and modernization initiatives.
Pay rate range (CAD): $70.00/hr – $75.00/hr
Responsibilities
- Develop and maintain end-to-end data pipelines on Azure Databricks using Python and Spark.
- Implement and optimize data transformations aligned with the Medallion Architecture (Bronze, Silver, Gold).
- Automate workflows incorporating Azure Data Factory for data ingestion and processing.
- Monitor pipeline performance, troubleshoot issues, and optimize data workflows.
- Collaborate with cross-functional teams to support data modernization efforts and ensure seamless data delivery.
- Support migration from legacy systems to scalable cloud data architecture.
- Ensure data quality, security, and compliance standards are maintained throughout all phases of data processing.
- Document technical designs, processes, and workflows for ongoing support and enhancement.
Desired Skill-Set
- Minimum of 5+ years of experience with Azure Databricks.
- Proficiency in Python programming.
- Strong knowledge of data modeling, data warehousing, and ETL best practices.
- Experience with automating data workflows using Azure Data Factory.
- Proven ability to monitor, troubleshoot, and optimize high-volume data pipelines.
- Hands-on experience with enterprise-scale data environments.
- Knowledge of cloud computing concepts and data security standards.
Nice to Have
- Familiarity with SQL and data visualization tools.
- Experience working in financial services or regulated environments.
- Knowledge of other cloud platforms such as AWS or GCP.
- Exposure to DevOps practices for data pipeline deployment.
- Certification in Azure Data Engineering or similar.
BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.