Azure Databricks Developer
Are you an experienced Data Engineer ready to lead a data modernization journey? Apply Now!
Working with one of our top financial clients, this role calls for an Azure Databricks Developer. This position is focused on designing, building, and optimizing scalable ETL pipelines to support enterprise analytics initiatives. The ideal candidate will have strong hands-on experience with cloud-based data platforms, data modeling, and collaborating with cross-functional teams to deliver business-driven data solutions.
Pay rate range (CAD): $65.00/hr – $74.00/hr
Responsibilities
- Design and develop reliable ETL pipelines for large-scale data ingestion and transformation from sources such as Oracle, SQL MI, MongoDB, and file-based feeds (CSV, JSON, Parquet) into Azure Databricks
- Build and maintain Databricks pipelines utilizing Medallion architecture (Bronze, Silver, Gold layers) with emphasis on Silver-layer data modeling for business use
- Ensure data quality, validation, and governance across all datasets
- Automate workflows using Azure Data Factory (ADF) and monitor pipeline performance to maintain reliability and scalability
- Collaborate effectively with business stakeholders, analysts, and data science teams to deliver high-quality data solutions
- Troubleshoot, optimize, and monitor data pipelines to ensure efficiency
Desired Skill-Set
- 5+ years of hands-on ETL development experience (low-level design acceptable; architecture not required)
- Proficiency in Python, Scala, and PySpark
- Strong experience with Azure Databricks and Azure Data Factory
- Working knowledge of Oracle, SQL MI, MongoDB, and file-based ingestion (CSV, JSON, Parquet)
- Solid understanding of data modeling and data warehousing principles
- Experience managing enterprise-scale, high-volume data environments
- Exposure to GitHub Copilot is a plus
Nice to Have
- Relevant cloud or data certifications (Azure or Databricks preferred)
BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.