Data Engineer – Python/ Azure SQL/ Snowflake/ Azure Databricks
Are you a data-driven professional passionate about transforming raw data into actionable insights and scalable business solutions? If you have a strong background in data engineering, analytics, and cloud-based data platforms, this is an exciting opportunity to contribute to innovative projects that shape data strategy and enable advanced analytics.
Working with one of our top clients, this role calls for a Data Engineer – Python/ Azure SQL/ Snowflake/ Azure Databricks who will design, build, and maintain end-to-end data pipelines and analytics platforms to support data science, business intelligence, and reporting initiatives. The successful candidate will collaborate with cross-functional teams across marketing, finance, supply chain, and IT to deliver robust, high-quality data solutions using the Microsoft Azure ecosystem and Snowflake platform.
Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Azure Data Factory, Snowflake, and SQL Server.
- Collaborate with analytics and business teams to understand requirements, build data models, and deliver optimized datasets for reporting and analysis.
- Develop and maintain data models and schemas in Snowflake to support analytics, machine learning, and reporting use cases.
- Optimize data pipeline performance and cost through automation, orchestration, and monitoring using tools such as Azure Synapse or Databricks.
- Ensure data quality, governance, and lineage across development, test, and production environments.
- Build and maintain CI/CD pipelines for data workflows using Azure DevOps and Git.
- Collaborate with data scientists to operationalize machine learning models and integrate outputs into production systems.
- Implement data security, access control, and compliance practices aligned with enterprise IT and governance standards.
- Create technical documentation, reusable templates, and frameworks to accelerate data delivery.
Desired Skill Set:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
- 3–5 years of hands-on experience in data engineering, ETL/ELT development, and data modeling.
- Strong proficiency in Python and SQL for data transformation, automation, and optimization.
- Proven experience with Snowflake, including schema design, data sharing, query optimization, and Azure integration.
- Expertise with Microsoft Azure data ecosystem — including Azure Data Factory, Azure Synapse, Databricks, Azure SQL Database, and Data Lake.
- Strong understanding of data architecture principles, data warehousing, and star/snowflake schema design.
- Experience with CI/CD pipelines, version control, and deployment using Azure DevOps or Git.
- Excellent communication and collaboration skills for cross-functional teamwork.
Nice to Have:
- Experience developing or supporting analytical datasets using Power BI.
- Familiarity with MLOps or integrating machine learning pipelines with data infrastructure.
- Knowledge of real-time data processing and streaming tools such as Azure Event Hubs, Kafka, or Stream Analytics.
- Exposure to data governance, metadata management, and data security frameworks.
- Background in CPG/FMCG, retail, or manufacturing data environments.
BeachHead is an equal opportunity agency and employer. We advocate for you and welcome anyone regardless of race, color, religion, national origin, sex, physical or mental disability, or age.